Community Psychology in a minute (or two)

In a recent Eval Cafe podcast episode, my co-host Carolyn Camman and I had a great conversation with Evan Poncelet about our professional journeys in the field of evaluation. All three of us come from an applied psychology background, and I spoke a bit about the influence and grounding I have courtesy of my “home field” of community psychology. For whatever reason, though, I sometimes find it difficult to provide a succinct definition of what community psychology is, or what it means to work from that perspective.

Fortunately, just last week a community psychologist, Leonard Jason, appeared on “The Academic Minute” podcast and in my opinion knocked it out of the park with explaining who we are and what we do (and in less than two minutes to boot!). The link above has both the audio and a full transcript of Dr. Jason’s presentation – I was originally planning to pull out a representative quote or two, but it’s short enough (as the podcast title implies) so I recommend simply going ahead and listening or reading it in its entirety.

February 13, 2019 News

Fun fact: -40 is the point where the Celsius and Fahrenheit scales converge. Do not ask me why I had reason to figure this out!

Saskatoon Events

The University of Saskatchewan’s Community Relations and Engagement Office is hosting a talk and workshop on February 27 with Jayne Malenfant on the topic of “Youth, Lived Experience and Inclusion in Community Research”. More details in the poster.

Technically not in Saskatoon, but Tamarack Community Institute is hosting a workshop in Edmonton on Asset-Based Community Development May 28-30. I’ve heard that there are some folks here in Saskatoon who are looking to register and travel together to save on costs and thus help build capacity in this area locally – if you’re interested in attending this workshop, drop me a line and I can put you in touch with those people.

Online Events

Kylie Hutchison will be leading a webinar on February 26 on hosting data parties.

Mark Cabaj and Galen MacLusky are hosting a Tamarack webinar on the Systems Change Evaluation Canvas on March 12.

Resource of the Week

Leadership Saskatoon is now accepting applications for their flagship 10-month leadership development program. I’m a grad of the program (Class of 2014) and have since co-facilitated a half-day session for the program and also act as a mentor. For more information on the application process, check out Leadership Saskatoon’s website.

Reinvigorating the Strong Roots Blog


Last year marked six years of operations for Strong Roots Consulting. I’m happy to say that the business is going strong, but there’s been one area that is way overdue for some re-development – this blog. A quick trip to the archives will show a variety of different post types, formats, and posting schedules, ranging from near-weekly to the year-long hiatus between the 2017 and 2018 Canadian Evaluation Society annual conferences.

This past summer, I spent some time reviewing where I see Strong Roots Consulting as a company growing and developing into. As part of that planning exercise I reflected on the role of this website generally and the blog specifically, identifying potential audiences and purposes and starting to sketch out what a posting framework would look like. What I realized was that I want this site to both serve as a general resource on evaluation, strategic planning, and related topics that can be useful to anyone who stumbles on this website, as well as a place to share relevant information and news for non-profits based in and around Saskatoon. At the same time, I wanted to make sure that the blog framework would be feasible in terms of time, so I could maintain a regular posting schedule and not let it lie fallow as in the past.

So, here’s what the blog will look like going forward. Every month will see a more in-depth post on a topic related to the skillsets here at Strong Roots Consulting. That monthly post can be an exploration of an approach or framework, a book review, or a walkthrough of a specific tool or technique. With a less-frequent schedule, I can take the time to focus on the topic and link in other resources so that the post will stay “evergreen” for some time.

In between these monthly deep-dives will be shorter posts on a variety of topics. Quick commentary on an article from another website, sharing a resource, and news about Saskatoon events of interest to the local non-profit scene would all fit in this category. These will be posted on ad-hoc basis but I’ll take care to space them out, especially for the sake of email subscribers to the site.

The key word for me in this new framework is being adaptive. As I go along, maybe I discover that the monthly posting schedule is too frequent and it’s better to more time to get it right – or conversely, that I can post twice-monthly at the quality level I expect. Similarly, perhaps the infrequent posts naturally cluster into certain types: local news comes to mind, and I’ve also seen other websites post a “I wished I wrote that” list on a regular basis. In any case, rather than creating something elaborate right now that could stumble coming out of the gate, I want to get a minimum viable product (to borrow the startup industry term) rolling and build it up as circumstances and my capacity dictate.

Here’s to a more blog writing in 2019!

Action, Innovation, Reflection – CES 2017 Day 1

For those who have read my posts from previous conferences, you wouldn’t be surprised that I get a lot out of these events – hearing great ideas, learning about new tools, connecting with friends and colleagues, and re-igniting the passion for the field I’m working in. Less than two days into the Canadian Evaluation Society’s 2017 conference, all of those positives are definitely here: if anything, it’s all heightened this year. There’s a feeling that my professional interests and skills are strongly aligning with those of my colleagues and the field as a whole, and that altogether there’s increased emphasis on what difference we as evaluators can make not just in our practice but for our communities and society as a whole.

I’m still thinking over everything I’ve seen and heard so far, from the great workshop on Developmental Evaluation led by Nora Murphy, Kate McKegg, and Nan Wehipeihana to a bumper-crop of thought-provoking Ignite presentations. This morning’s keynote speakers, Indigenous evaluation consultant Kim van der Woerd, co-founder of the Moosehide Campaign Paul Lacerte, and Elder Roberta Price, really helped set the narrative for this conference and our field in general – that we all need to work towards reconciliation, and as Lacerte said, we are at a precious moment in the history of our country (and the world!) to face forward towards a shared future. Outside of the formal program, I’m incredibly grateful to both connect with like-minded conspirators and co-create with them. As an example, I’m writing this post at the lunch table with someone I’ve known for several years now as well as someone I’ve just met: we all connected via Twitter to make this time to write and reflect happen, and I won’t be surprised if other ideas and initiatives arise from these planned and spontaneous gatherings in the days to come.

If you’re wanting to see some specifics about ideas and concepts, check out Twitter – I’ve been live-tweeting pretty regularly and the conference hashtag (#EvalC17) has seen lots of activity and discussion. 

As a final thought, a tweet that summarizes my feelings so far:

“My take-away from #EvalC17 so far: we as evaluators do not work in a vacuum – we must attend to history and culture including our own”

Evaluate As If Nobody’s Watching

Two quick announcements before today’s post. First, as I mentioned last week, I’m heading off to the annual conference of the Canadian Evaluation Society, taking place April 30 – May 3 in Vancouver. I’m looking forward to connecting with friends and colleagues during that time, so if you’ll be in attendance, look me up! I’m hoping to write some blog posts while out there and will likely be active on Twitter. Important to note – while I will have email access, I may be delayed in responding to emails, both during the conference and the following week (up to and including May 10) as I’ll be taking some vacation time in the area following CES.

The second announcement is more of testing the waters. Vu Le, non-profit unicorn extraordinaire and the man behind the thought-provoking site Nonprofits with Balls1, recently suggested Thursday May 25 as a day for non-profit agencies and funders to meet (jump to the end of the post) – not with any formal agenda, but simply to connect as individuals and chat. I’m thinking to arrange this kind of meetup in Saskatoon – any of my readers interested? Drop me a line if you this is something you’d like to see.

(As a side note, I had drafted up the post below before learning about this event – chalk it up to coincidence and/or fate that it’s related to funders and evaluation!)

Evaluation and accountability: for many non-profit organizations, these two concepts are inextricably linked. Granting bodies, in providing funds for programs and services, expect that their resources are used to create positive change, whether it’s improved test scores for children, stabilized living situations for those in crisis, or fewer people living in poverty. As part of the application process, most funders ask would-be recipients to provide the goals and objectives of their program, along with outlining how they will demonstrate whether these goals are being met. Successful applicants are then required to report on these metrics to show that the funds were used effectively.

Don’t get me wrong – accountability is an important function for evaluation, both for the funders and the organization themselves. After all, why spend money and staff time on a program or service that is not creating its intended effect? At the same time, evaluation can provide multiple benefits for non-profits, including through means that wouldn’t prompt comparisons with a visit from financial auditors.

Uncertain about how evaluation can be useful beyond satisfying funder requirements? Follow along for a quick thought experiment. Take the phrase “dance as if nobody was watching” and apply the general principle – namely “Evaluate as if no funder or key external stakeholder would see the results” (not as succinct as the original, but you get the idea). What if we evaluated for a purpose beyond accountability? What would the process look like, in what ways would it differ from previous evaluations completed solely for a funder, and how would we use it?

Continue reading

CES 2017: Evaluation and Change

I find it interesting that the two major evaluation conferences I attend are usually scheduled in spring and fall (respectively), the seasons of change1. At its heart, the field is about change: both in terms of understanding and cataloguing what has transpired as the result of an intervention or program, but also supporting new developments by providing feedback and ideas for further improvements and refinement. There’s one more reason why change is central to evaluation, though – our work is not immune to it either. We have to be aware that our contexts and those we partner with also face change regularly, requiring us evaluators to identify and understand what’s happening around us and respond in kind.

The two sessions I’m presenting at the upcoming Canadian Evaluation Society (CES) conference in Vancouver both touch on this idea of being aware of and responsive to our contexts2. Kirstie Gibson, a former placement student with Strong Roots Consulting, and I will be presenting on research that we conducted with local non-profits that examined their perspectives on evaluation. My other session, with Craig Moore of South Shore Evaluation in Nova Scotia, is a thematic breakfast roundtable that invites other consultants from smaller cities and regions in Canada (loosely defined) to chat about the benefits and challenges related to being “the only one in town” when it comes to evaluation consulting. Two pretty different topics, but I think there’s a common thread around the importance of communication and collaboration to successfully navigate situations that are much more complex than the safe examples we practice with in workshops or classroom settings.

With CES approaching in less than two weeks, I’m looking forward to the opportunity to connect with colleagues from across Canada and even other continents (I’m attending a workshop that includes presenters from New Zealand!). More importantly, these events always provide an opportunity to expand my thinking, identify new approaches and methods that I can incorporate into my practice, and most importantly, remind me that when change happens, there’s a community there to help me make sense of it. For my friends and colleagues who will be in attendance, I’ll see you soon in Vancouver! Everyone else, keep an eye on this blog and the Strong Roots Twitter account the week of April 30 as I share insights and ideas from the conference.

  1. Yes, I understand that there are only so many months in the year to hold a conference, that traveling during the winter sucks and many people would rather be on vacation in summer than sitting in a convention centre somewhere – it’s a metaphor, just let me roll with it! 
  2. I’d like to pretend that this was intentional – perhaps subconsciously? 

Sharing and Connecting: Innovation at CES 2017

It’s most definitely fall in Saskatoon – nights dip below freezing, the trees have shed most of their leaves, and it’s only a matter of time before the snow hits1. Another sign of fall? Upcoming due dates to submit presentations for conferences, including the Canadian Evaluation Society’s 2017 conference in Vancouver.

Earlier this year, I wrote about the conference and its theme of Facing Forward: Innovation, Action, and Reflection. Today, I’d like to focus on Innovation – but instead of looking at innovation in evaluation, let’s talk innovation in conferences. My experiences at evaluation conferences (both in Canada and south of the border) have been overwhelmingly positive: at the same time, I’m aware that these events can be criticized for not being the most effective use of time and resources. Indeed, there are numerous ways today that we can learn from others without having to leave the comfort of home – including blogs such as this one! As a result, it’s a legitimate question to ask whether it’s worth spending hundreds of dollars (if not thousands, when you account for travel and accommodations) to make the trip.

One of the key benefits I have taken away from conferences is the opportunity to connect with others walking a similar journey. These events give me the chance not just to learn from others, but to share my own experiences and have a real dialogue where ideas can arise from the space between. True, we can have this two-way communication through words or video, but there’s something about being in the same room together or perhaps pitching ideas over a meal (or pint) that contributes to the generation of innovative ideas.

Although most of these connections are informal, the conference organizers can set things up to encourage such dialogue. For CES 2017, the team behind the conference have provided some interesting presentation types that I’m excited to both see in person and also participate in as a presenter. One type in particular, called “Consultation and Collaboration”, is a highly interactive format that asks attendees to work in groups in response to a problem, issue, or topic brought forward by the session organizers. Giselle Patrick, Carolyn Camman, and I have submitted a proposal under this format on the topic of evaluation capacity building (ECB), with a focus on how ECB can be conceptualized and put into practice for different types of organizations. We look forward to bringing some unique engagement activities to our session and seeing what comes out of the conversation!

There are several other interesting presentation types this year, including Storytelling, Thematic Breakfast Roundtables (I’m thinking to host one on consulting in small and mid-sized cities), and Lightning Round Tables that sound like a mix of speed networking and information sharing. And of course, there’s my perennial favourite, Ignite presentations, where your slide deck automatically advances through 20 slides, 15 seconds a slide, for a total of 5 minutes. I’ve found it a fun challenge to craft a coherent presentation to fit within these limitations, and likewise have enjoyed seeing what others do with this format!

One activity that I’d love to see at CES conferences is based on an idea from our American colleagues, specifically the Community Psychology Topic Interest Group (CP TIG) of the American Evaluation Association (AEA)2. At the annual AEA conference, this TIG hosts an event called “Walk the Talk”, where conference attendees can sign up for a tour of a local community agency or group to learn more about their work, see how they use evaluation, and provide ideas and suggestions for the agency to move forward in accomplishing their mission. Vancouver, like communities across this country, is home to numerous agencies of all stripes and sizes doing amazing work, and I think it would be worthwhile to go beyond the conference venue to learn more and contribute back to these organizations.

So suffice to say, I’m looking forward to this conference, both as a participant and contributor – the hard part is deciding what ideas I want to present on! Fortunately, I still have another week and a half to finalize and submit my proposal(s). Over to you now: What are you planning to present on, if you’re going? What are some innovative presentation formats that you’ve seen at other conferences? Share in the comments below or on Twitter, or drop me a line!

  1. That is, until the snow hits again: Saskatoon saw an extended preview of winter at the beginning of October.
  2. Apologies for the acronym soup in this post!

The Next Best Thing

Tomorrow, Apple will lift the veil on its newest product, most likely a new iPhone1. If past behaviour is any indicator, there will be much discussion and many questions asked in the immediate aftermath: is this a good product, should people buy it, is Apple being forward-thinking or foolish in removing the headphone jack (if the rumours are to believed), and so on. One topic that likely won’t come up, though, is what the company will do with the profits it realizes from the new phone and its other products.

What we don’t ask of Apple or other for-profit companies stands in notable contrast to the questions and restrictions imposed on non-profit organizations when they receive funding. I won’t belabour the general point here, as others have written amazing pieces dismantling these harmful ideas: as one example, Vu Le provided a hilarious-because-it’s-absurdly-true example of trying to run a bakery if we brought to bear the overhead and sustainability myths that non-profits routinely face. More specific to my focus on evaluation and research, Ann Rosenfield (hat tip to Joe Travers) pointed out that donors should actually want to pay for a charity to collect and analyze data about their programs, spend time understanding local trends, and develop and test new approaches to fulfilling their mission. Although these dollars may not go directly towards the front-line program or service, they ensure that the organization continues to operate effectively and is prepared for what the future will bring.

When buying any kind of gadget from a for-profit company, it’s understood that the amount we spend will be used for more than just the product itself. In fact, I think we would be surprised and maybe even angry if companies like Apple didn’t spend at least some money on improving their products and developing new ideas. In the non-profit world, our R&D work (which includes evaluation for me) is often seen as an afterthought, not just by donors and funders but by those working in the field. Sure, we may never see our work featured and feted like a new technological marvel: instead, though, we can develop new ways of creating positive change that save lives, dismantle systems of oppression, and generally improve quality of life for individuals and communities around the world. To reach that potential, though, our sector as a whole needs to invest the time and resources necessary to improve what we’re already doing, understand what’s coming over the horizon, and develop our own “next best thing”.

  1. And possible a new Apple Watch, depending on which prognosticators you want to believe.

Facing Forward

From previous blog posts (see here, here, here, and here), you can tell that I’m a fan of expanding my skills and learning in evaluation through conferences. Attending these events, hosted by the Canadian Evaluation Society and the American Evaluation Association, has also connected me into a diverse community of practitioners, academics, consultants, students, grantmakers, government officials, and more who are brought together by a common interest in the field of evaluation. Given this blend of learning, sharing, and connecting, I try to make it out to these conferences whenever circumstances allow.

The next Canadian Evaluation Society conference will be taking place in Vancouver from April 30 to May 3, and I’m excited for a couple of reasons – not least because Vancouver is a beautiful city to visit, relatively close1 to my home base of Saskatoon, and home to several evaluation colleagues and friends. What really piqued my interest is an initiative for the conference that’s being led by one of those colleagues and friends, Sarah Farina of Broadleaf Consulting. Evaluators are being encouraged to blog on the conference theme (Facing Forward: Innovation, Action and Reflection) in the months leading up to the conference. It’s a neat way to start the conversation well in advance of the meeting itself, and hopefully have it continue afterwards!

Evaluation’s Present and Future

Over the next 8 months, I’ll be delving more deeply into each component of the conference theme: today’s post will take more of an overarching view.

Innovation, Action, Reflection. My first thought on seeing these three words is that I wish that the organizing group hadn’t chosen this theme, as I would be tempted to use it as a tagline for my business! Unpacking the ideas a bit further, I think it reflects where evaluation is today and our current trajectory. Our field has had the reputation (with some historical basis) of acting as arbiters of a program’s fate by rendering simplistic thumbs-up/thumbs-down judgements, and thus raining on the parades of those who are trying to make a difference in the world. While evaluation continues to play a role in promoting accountability, to say that’s our only focus does the field a great disservice.

Based on my experience, the core element of evaluation is using applied social research skills to help those seeking to create change learn more about the work they do and how they can improve their efforts. Evaluators help organizations understand their successes (and failures), provide feedback and suggestions for change, and work alongside developing projects or initiatives to provide real-time data and insights. Yes, there will always be times where we have to pass judgement and say that this program did or did not work as intended to achieve its desired outcomes: that being said, we have both the opportunity and the responsibility to ask how those assessments can support action, encourage reflection, and ultimately promote innovation to tackle the complex issues we see affecting our communities and the world.

As noted above, my plan is to blog about each of those three aspects (Innovation, Action, Reflection) over the next several months leading up to the conference. For more information about the conference, check out

  1. Well, close by Canadian standards, at least. 

Learning Circles

Professional Development on the Prairies

This summer will mark four years for me in Saskatoon, and while there are many things I love about this city1, there are a few small challenges. One specifically related to my work is the relative isolation: the nearest city of comparable size is the provincial capital of Regina, which is a two hour drive away: for larger centres, it’s five hours to Edmonton, seven to Calgary, and eight to Winnipeg. There have been many times where I’ve learned about interesting professional development opportunities in those places or further afield: unfortunately, the time and cost associated with travel can be huge barriers to attending. Although technology has helped fill the gap somewhat, such as through webinars, those methods also have their downsides. Interaction with other participants and the presenters tends to be minimal or non-existent, and it’s all too easy to skip a webinar or attempt to multi-task during it (hint: that strategy doesn’t work, at least not for me!).

Yesterday, I learned about an interesting professional development model that could provide the best of both worlds. Shelley Borys and Natalie Kishchuk presented a webinar hosted by the Canadian Evaluation Society on the concept of learning circles. In their use of this model, a small group of participants (5-7 typically) would meet regularly through one-hour teleconferences: through a cycle of six such sessions, they would discuss different evaluation topics and methods, chosen based on the interest of the group members. Each session would have one of the members act as leader who would be responsible for facilitating the discussion and also selecting the materials and resources for everyone to review in advance. Although the group used teleconference as the means for conversation, online tools such as Dropbox and a shared spreadsheet helped disseminate resources and select discussion topics, respectively.

Evaluate Thyself

Beyond finding this idea interesting, there’s another reason why I’m sharing this example. As you’d expect from a group of evaluators, they evaluated how well this method worked as an educational tool through a brief survey of participants. The outcomes were positive, though with an unexpected result when they delved a bit deeper into the findings. As one would reasonably assume, participants brought different levels of knowledge on different topics: one person may have a high learning need for, say, developmental evaluation, but would only need a refresher on empowerment approaches. However, some participants would initially rate their knowledge on a certain topic as low, but after participating in the discussion would realize they knew more on the subject than they thought. In these cases, dubbed “Comforted” learners by the evaluators, participants would gain confidence in the knowledge that they already possessed (usually from their own personal experience), and also gain support and validation in their skills from the other group members.

These and other findings, such as the importance of balancing similarity and diversity among the group members, highlights the importance of looking beyond surface-level question such as “Did the program work?” or “Were participants satisfied?”. The knowledge gained from examining the reasons for success and underlying processes could help identify who would most benefit from the program: for example, the finding around Comforted learners could indicate that such circles could support early- to mid-career evaluators who have developed a skill base but may be uncertain in their own knowledge. Alternatively, if a group doesn’t work out, the evaluation findings could help determine why: perhaps the composition was too uniform and thus lacked diversity of knowledge and opinion, or the trust among group members wasn’t sufficient to allow people to admit uncertainty or lack of knowledge. Rather than throw out the learning circles model with the bath water, changes could be made to improve the odds of success for the future.

Let’s Start!

Based on what was shared in the webinar, I’m really excited about the prospect of being involved in a similar group. I already belong to a small online group of Canadian evaluators, and I think this approach could be a promising one to introduce some regular discussion. A learning circle approach held in-person could potentially be fruitful here in Saskatoon, though perhaps on a broader topic such as community-based research. If you’re interested in working with me to start up a learning circle in either (or both) directions, or would like to share your experiences with this type of mutual learning, feel free to share in the comment section below, drop me a line through the Contact page or find me on Twitter.

  1. Especially now that we’re fully into spring and patio season is just around the corner!