The Next Best Thing

Tomorrow, Apple will lift the veil on its newest product, most likely a new iPhone1. If past behaviour is any indicator, there will be much discussion and many questions asked in the immediate aftermath: is this a good product, should people buy it, is Apple being forward-thinking or foolish in removing the headphone jack (if the rumours are to believed), and so on. One topic that likely won’t come up, though, is what the company will do with the profits it realizes from the new phone and its other products.

What we don’t ask of Apple or other for-profit companies stands in notable contrast to the questions and restrictions imposed on non-profit organizations when they receive funding. I won’t belabour the general point here, as others have written amazing pieces dismantling these harmful ideas: as one example, Vu Le provided a hilarious-because-it’s-absurdly-true example of trying to run a bakery if we brought to bear the overhead and sustainability myths that non-profits routinely face. More specific to my focus on evaluation and research, Ann Rosenfield (hat tip to Joe Travers) pointed out that donors should actually want to pay for a charity to collect and analyze data about their programs, spend time understanding local trends, and develop and test new approaches to fulfilling their mission. Although these dollars may not go directly towards the front-line program or service, they ensure that the organization continues to operate effectively and is prepared for what the future will bring.

When buying any kind of gadget from a for-profit company, it’s understood that the amount we spend will be used for more than just the product itself. In fact, I think we would be surprised and maybe even angry if companies like Apple didn’t spend at least some money on improving their products and developing new ideas. In the non-profit world, our R&D work (which includes evaluation for me) is often seen as an afterthought, not just by donors and funders but by those working in the field. Sure, we may never see our work featured and feted like a new technological marvel: instead, though, we can develop new ways of creating positive change that save lives, dismantle systems of oppression, and generally improve quality of life for individuals and communities around the world. To reach that potential, though, our sector as a whole needs to invest the time and resources necessary to improve what we’re already doing, understand what’s coming over the horizon, and develop our own “next best thing”.

  1. And possible a new Apple Watch, depending on which prognosticators you want to believe.

Facing Forward

From previous blog posts (see here, here, here, and here), you can tell that I’m a fan of expanding my skills and learning in evaluation through conferences. Attending these events, hosted by the Canadian Evaluation Society and the American Evaluation Association, has also connected me into a diverse community of practitioners, academics, consultants, students, grantmakers, government officials, and more who are brought together by a common interest in the field of evaluation. Given this blend of learning, sharing, and connecting, I try to make it out to these conferences whenever circumstances allow.

The next Canadian Evaluation Society conference will be taking place in Vancouver from April 30 to May 3, and I’m excited for a couple of reasons – not least because Vancouver is a beautiful city to visit, relatively close1 to my home base of Saskatoon, and home to several evaluation colleagues and friends. What really piqued my interest is an initiative for the conference that’s being led by one of those colleagues and friends, Sarah Farina of Broadleaf Consulting. Evaluators are being encouraged to blog on the conference theme (Facing Forward: Innovation, Action and Reflection) in the months leading up to the conference. It’s a neat way to start the conversation well in advance of the meeting itself, and hopefully have it continue afterwards!

Evaluation’s Present and Future

Over the next 8 months, I’ll be delving more deeply into each component of the conference theme: today’s post will take more of an overarching view.

Innovation, Action, Reflection. My first thought on seeing these three words is that I wish that the organizing group hadn’t chosen this theme, as I would be tempted to use it as a tagline for my business! Unpacking the ideas a bit further, I think it reflects where evaluation is today and our current trajectory. Our field has had the reputation (with some historical basis) of acting as arbiters of a program’s fate by rendering simplistic thumbs-up/thumbs-down judgements, and thus raining on the parades of those who are trying to make a difference in the world. While evaluation continues to play a role in promoting accountability, to say that’s our only focus does the field a great disservice.

Based on my experience, the core element of evaluation is using applied social research skills to help those seeking to create change learn more about the work they do and how they can improve their efforts. Evaluators help organizations understand their successes (and failures), provide feedback and suggestions for change, and work alongside developing projects or initiatives to provide real-time data and insights. Yes, there will always be times where we have to pass judgement and say that this program did or did not work as intended to achieve its desired outcomes: that being said, we have both the opportunity and the responsibility to ask how those assessments can support action, encourage reflection, and ultimately promote innovation to tackle the complex issues we see affecting our communities and the world.

As noted above, my plan is to blog about each of those three aspects (Innovation, Action, Reflection) over the next several months leading up to the conference. For more information about the conference, check out

  1. Well, close by Canadian standards, at least. 

Learning Circles

Professional Development on the Prairies

This summer will mark four years for me in Saskatoon, and while there are many things I love about this city1, there are a few small challenges. One specifically related to my work is the relative isolation: the nearest city of comparable size is the provincial capital of Regina, which is a two hour drive away: for larger centres, it’s five hours to Edmonton, seven to Calgary, and eight to Winnipeg. There have been many times where I’ve learned about interesting professional development opportunities in those places or further afield: unfortunately, the time and cost associated with travel can be huge barriers to attending. Although technology has helped fill the gap somewhat, such as through webinars, those methods also have their downsides. Interaction with other participants and the presenters tends to be minimal or non-existent, and it’s all too easy to skip a webinar or attempt to multi-task during it (hint: that strategy doesn’t work, at least not for me!).

Yesterday, I learned about an interesting professional development model that could provide the best of both worlds. Shelley Borys and Natalie Kishchuk presented a webinar hosted by the Canadian Evaluation Society on the concept of learning circles. In their use of this model, a small group of participants (5-7 typically) would meet regularly through one-hour teleconferences: through a cycle of six such sessions, they would discuss different evaluation topics and methods, chosen based on the interest of the group members. Each session would have one of the members act as leader who would be responsible for facilitating the discussion and also selecting the materials and resources for everyone to review in advance. Although the group used teleconference as the means for conversation, online tools such as Dropbox and a shared spreadsheet helped disseminate resources and select discussion topics, respectively.

Evaluate Thyself

Beyond finding this idea interesting, there’s another reason why I’m sharing this example. As you’d expect from a group of evaluators, they evaluated how well this method worked as an educational tool through a brief survey of participants. The outcomes were positive, though with an unexpected result when they delved a bit deeper into the findings. As one would reasonably assume, participants brought different levels of knowledge on different topics: one person may have a high learning need for, say, developmental evaluation, but would only need a refresher on empowerment approaches. However, some participants would initially rate their knowledge on a certain topic as low, but after participating in the discussion would realize they knew more on the subject than they thought. In these cases, dubbed “Comforted” learners by the evaluators, participants would gain confidence in the knowledge that they already possessed (usually from their own personal experience), and also gain support and validation in their skills from the other group members.

These and other findings, such as the importance of balancing similarity and diversity among the group members, highlights the importance of looking beyond surface-level question such as “Did the program work?” or “Were participants satisfied?”. The knowledge gained from examining the reasons for success and underlying processes could help identify who would most benefit from the program: for example, the finding around Comforted learners could indicate that such circles could support early- to mid-career evaluators who have developed a skill base but may be uncertain in their own knowledge. Alternatively, if a group doesn’t work out, the evaluation findings could help determine why: perhaps the composition was too uniform and thus lacked diversity of knowledge and opinion, or the trust among group members wasn’t sufficient to allow people to admit uncertainty or lack of knowledge. Rather than throw out the learning circles model with the bath water, changes could be made to improve the odds of success for the future.

Let’s Start!

Based on what was shared in the webinar, I’m really excited about the prospect of being involved in a similar group. I already belong to a small online group of Canadian evaluators, and I think this approach could be a promising one to introduce some regular discussion. A learning circle approach held in-person could potentially be fruitful here in Saskatoon, though perhaps on a broader topic such as community-based research. If you’re interested in working with me to start up a learning circle in either (or both) directions, or would like to share your experiences with this type of mutual learning, feel free to share in the comment section below, drop me a line through the Contact page or find me on Twitter.

  1. Especially now that we’re fully into spring and patio season is just around the corner! 

Learning Experiences

Student practicums or placements can be a great opportunity for non-profit organizations to provide a student with real-world experience while benefiting from their knowledge and skills. Most placements are required for the completion of a graduate or professional degree; however, some upper-year undergraduate courses include this form of experimental learning as well. Depending on the nature of the placement and the course or degree requirement, the student will be required to complete a set number of hours for the organization, although they may also need to complete specific project or reporting requirements in order to receive credit.

Here in Saskatoon, we’re fortunate to have multiple opportunities to engage with students through programs at the University of Saskatchewan and Sask Polytech, as well as students living here who are enrolled in programs at the University of Regina (notably social work students) and other institutions. Working with local non-profits, it’s pretty rare to encounter one that does not have previous experience with a placement student: in particular, I don’t know if I have worked with an organization that doesn’t have a report penned by a Masters of Public Health student somewhere in their file drawers!

Today I wanted to quickly draw attention to two placement programs that may fly under the radar, plus a learning opportunity that I'll be offering through Strong Roots starting tomorrow!

Applied Social Psychology

As the name suggests, the Applied Social Psychology focuses on the use of social psychology research methods to address social issues1. Part of their coursework includes learning about evaluation approaches and techniques. In fact, the program regularly participates in the Canadian Evaluation Society’s Student Evaluation Case Competition, with the university’s teams winning in 2004, 2011, and 2015, and being selected as finalists in 2002 and 2010. Clearly, they know something about evaluation!

Graduate students in both the Masters and PhD programs are required to complete two placements, one over the summer and one during the school year, with external organizations. I’ve been fortunate to have Kirstian Gibson, who’s in her second year of the Masters, working with me since the fall. In the past several months, she has taken lead on a pro bono evaluation project with a local non-profit, provided support on some ongoing client project, and also co-initiated a research project on how non-profit staff and leaders in Saskatoon view evaluation. It’s been great working with a student who has a strong grasp of evaluation and social research methods (she was part of the winning case competition team in 2015), and I look forward to working with another student from the same program this coming summer.

For more information about the placement, the best person to contact is Dr. Karen Lawson.

Governance Leadership Development Practicum

The for-profit and non-profit worlds don't always see eye-to-eye, but in the case of the Governance Leadership Development Practicum at U of S' Edwards School of Business, it's a great match. This fourth year undergraduate course combines an intense seminar focusing on non-profit governance issues with a practicum experience that places students with local non-profit boards over the course of two semester. I've been involved with this program for the last two years now as a non-profit board mentor, and it's been a great experience with both students. The course provides them with a wealth of knowledge about board governance issues, and the students’ business backgrounds have provided new ideas and insights for the board moving forward.

For more information about this opportunity (applications for the fall should be opening later this spring), contact Dr. Chelsea Willness.

Numbers and Stories office hours

On the topic of learning and sharing skills, I’m happy to announce that Strong Roots Consulting is partnering with The Stand Community Organizing Centre here in Saskatoon to host a regular ”Numbers and Stories" office hour! Any non-profit is welcome to visit me at The Stand (615 Main Street, just east of Broadway: same building as Turning the Tide bookstore) on Wednesdays from 1-3pm for free advice and assistance on topics related to evaluation and community-based research. Some of the help I can provide includes giving feedback on a survey, deciphering what a grant application is asking for in the evaluation section, or brainstorming ideas on how to best engage with your organization’s members.

The first office hour happens tomorrow afternoon – hope to see you there!

These three opportunities are just scratching the surface for different initiatives that support non-profits. Share your experiences and recommendations for placement programs or other educational opportunities in the comments field below, or continue the conversation on Twitter!

  1. The field is very similar in focus to my own disciplinary background of Community Psychology. ↩︎

AEA Conference – Connections

Right now, I have a bunch of ideas floating in my writing list from this conference. New tools, new insights, new ideas for programs or approaches that could be useful back home in Saskatoon. I think I could write up one of those topics each week between now and the end of the year and perhaps get through them all, though I still have a half-day left to add to that list.

I’m not going into any of those takeaways right now, because one thing keeps coming up in my mind: the importance of connections at this conference. Over the past few days, the laws of probability have been strained around how often I’d run into colleagues and friends, including one person who (we managed to figure out) I had met at a conference 8 years ago. I’ve had conversations with people from around the world and even ran into a few non-Canadians who know where Saskatoon is. I’ve had the opportunity to learn from and be inspired by other independent consultants, and hopefully provide them with some ideas in return. And last but not least, I’ve had the opportunity to laugh and share some inside evaluator humour, including through the magic of Chris Lysy’s cartooning.

Over the coming days, I hope to produce a more content-focused roundup of the conference, but in the meantime, to everyone I’ve had the chance to discuss and learn from and share with, thank you.

AEA Conference – A Call

Given that this is my third such conference, I should no longer be surprised that Eval 2015 is an amazing, overwhelming, encouraging, and ultimately empowering event! Both of my workshops were great learning opportunities leaving me with lots of ideas to bring back home to Saskatoon, I’ve run into several friends and colleagues already, and I managed to push past the butterflies in my stomach to successfully deliver my Ignite presentation. Seriously, give that format (or its cousin, Pecha Kucha) a try sometime – a set number of slides that change automatically, it’s a rush to present!
AEA Opening Plenary

The theme of this year’s conference is Exemplary Evaluations in a Multicultural World, and if the number of flags on stage at the opening ceremony is any indication, it’s definitely a global audience. I was proud, though perhaps not too surprised, to see that Canadians make up the largest non-American contingent at 139. And yet we don’t have our own badge ribbon? Next conference I should bring some maple leaf stickers.

I was heartened to see the opening ceremony beginning with a traditional welcome from a local Indigenous group. There’s a growing recognition in Canada and apparently the US as well of at least acknowledging the history of the land and people where we are meeting, and I hope this becomes the norm for events generally.

If there’s one take away from my experiences here thus far, it’s that we have the opportunity and the call to up our game as evaluators. Our field is gaining international recognition and legitimacy (2015 is the UN-recognized International Year of Evaluation), our skill sets are increasingly viewed as important and even necessary in creating sustainable social change, and at the same time we’re recognizing that we’re working in increasingly complicated and even complex situations. Our toolkit is growing to incorporate new ways of presenting data, engaging stakeholders, and demonstrating impact. We’re called to be exemplary.

Yes, it can be overwhelming and even a bit anxiety-provoking – who am I to take on these tasks and responsibilities? At the same time, it’s exhilarating to be here at this place and time, and to have this opportunity to learn and grow. I look forward to the rest of the conference, and more importantly, what I can and will do in the weeks and months to come to create a better world.

AEA in the Windy City

Greetings from Chicago! I arrived in town last night to attend the American Evaluation Association’s annual conference, the third such time I’ve attended this massive gathering of evaluators. Taking a quick look through the program, I’m still excited and overwhelmed by the sheer number of interesting sessions and workshops: even after three years, it’s difficult to choose what to take in without burning out!
This year, I’m also presenting in two sessions, one an Ignite talk on my professional path to evaluation, and the other one a more traditional presentation on development evaluation. I’m looking forward to the next few days, but between those talks, two workshops that I’m participating in, networking with colleagues old and new, and of course some time to explore this beautiful city, that time is going to pass by fast.

If you’re at the conference, feel free to drop me a line – I’m always up for a conversation! The best way to reach me the next few days is by Twitter or by email. Note that I am not reachable at the phone number on my contact page between now and the 15th: if you need to reach me by phone, contact me by email and I can send you my temporary US number.

As with past conferences, I will be tweeting regularly and also blogging on a daily basis if possible.

And yes, it’s been windy here!

Community View

Good news for non-profits: there’s a ton of information and data out there to help you understand your community and the people who live in it. Bad news for non-profits: there’s a ton of information and data out there. It can be hard to find what you’re looking for across multiple sites and agencies, especially if you aren’t certain who hosts which indicators. Even if you know where to look, it often takes a lot of time to gather that information and convert it into a useful format.

Given these challenges, I was happy to learn about Community View, a catalogue of data for Saskatoon and area. Developed by Saskatoon Health Region and supported by several local partners including the University of Saskatchewan, it’s an online tool that provides free access to a host of community-level indicators.

Community View

Last week I attended a workshop on using the tool, and a couple things stood out for me:

  • There’s a great range of reliable data sources – mostly census1 but also other sources such as from the Health Region and the school boards
  • The “data cart” feature sounds like an odd idea at first, but once you start using it to select indicators, it makes perfect sense.
  • Data can be easily filtered, including down to the neighbourhood level in Saskatoon for most stats. Filters can be applied to individual data sources or to the whole cart of indicators2.
  • Mapping tools are included, with options to show data (again on the neighbourhood level for most indicators) as either colour gradients or sized circles.
  • Data can be viewed in tabular form in the web browser as well as exported to Excel.
  • For the stats nerds among us, there are advanced features to play around with including setting different cutoffs for colour gradients on the map, creating new variables based on mathematical expressions (such as percentages), and uploading your own geocoded data to be mapped.
  • To bolster the amount of information available, documents such as written reports and articles are also included. Fortunately, it is easy to filter these documents out from listings and search results if you’re just looking for data sets.

Overall, Community View is a great resource for Saskatoon-based community researchers. For someone new to the world of community-level data and the online platforms that house them, it may be a bit intimidating at first: efforts such as the workshop I attended were clearly designed to alleviate the learning curve. Otherwise, I just wish that I had known about this tool sooner, and as one of the workshop attendees commented, that it was available for data across Canada!

What do you think about this tool? Are there similar websites out there that similarly bring together multiple datasets for community researchers? Share in the comments below, through Twitter, or the usual contact means.

  1. Including the infamous National Household Survey ↩︎
  2. Notwithstanding some peculiarities when mixing and matching different data sources ↩︎

Change in the Air

Shorts have been replaced by jackets, there’s a chill in the air, and leaves are starting to change – fall is definitely here in Saskatoon!
Rather than lament the end of summer (and the short time before we’ll be talking about the frozen white stuff hitting the ground!), I would like take a minute to look back with gratitude. Overall, it was a great summer, balanced between work and relaxation, travel and time around Saskatoon, looking back and looking forward. I had the opportunity to meet up with friends and colleagues in Vancouver, convened my advisory group for the first time, and created a strategic document to help guide my work over the next 12 months. Most importantly, I was able to spend some timing in reading and reflecting on what exactly is the core or heart of my work: what is the change that I want to see?

I’m really excited about the months to come, with some awesome projects starting up, the American Evaluation Association’s conference in Chicago to prepare for, and the opportunity to grow what Strong Roots can be – look for more on that in the weeks and months to come!

Over to you – how was your summer? What’s got you excited for the fall? Comment below or through Twitter!

News: Crowdfunding and Bunnyhugs

Lots on the go! If you’re based in Saskatchewan and work in the area of poverty reduction (or even if you don’t and simply care about the issue, which really should apply to everyone!), I strongly recommend you check out the survey link in the second item below related to the provincial government’s poverty reduction strategy. The survey closes this Friday, so don’t delay!

Webinar on Board Diversity: Ideally, non-profit boards of directors are reflective of the communities they work in: this goal is not often met in practice. This Thursday, May 14 at 11am Sask time (1pm Eastern), a free webinar on Building Board Diversity and Inclusion (hat tip to Sheena Greer at Colludo!) will focus on “how to bring more diversity to your board and create a board culture that values diversity beyond the check box.”

Poverty Reduction Survey: Saskatchewan is one of two provinces in Canada without a comprehensive poverty reduction strategy. Last year, efforts by the Poverty Costs initiative brought this issue onto the public radar, leading the provincial government to form an Advisory Group on Poverty Reduction to provide input into the formation of a strategy. That group is now asking for public feedback from both individuals and organizations through a brief online survey. Act fast, as it closes this Friday, May 15.

Leadership Saskatoon is holding a Sandbox Lunch and Learn on Wednesday May 27. Using a World Cafe approach, participants will learn about the Canada300 project and discuss the future of Canada over the next 150 years. Given the scope of the topic, it’s a longer session than usual, running 11:30-1:30 at the Affinity Credit Union’s St Mary’s branch (20th Street West and Avenue P). RSVP’s are required by May 22 – contact information and more details on the poster.

Still on Leadership Saskatoon, the application period for 2015-16 Leadership Saskatoon cohort is open until June 1. If you’re interested in applying, don’t delay!

Crowdfunding! Two amazing Saskatoon initiatives are running crowdfunding campaigns – check them out, as they’re both worthy of your support!

Next Up, a great youth leadership program focusing on social and environmental justice issues1, is looking for support to host an intensive session for First Nations and Métis youth. This is the second time for this specific session, and last year’s offering saw an amazing response. Money raised for this year will help provide program supplies, honoraria, and travel and childcare subsidies.

Treaty 6 Justice Collective has launched a campaign in support of a new community space called The Stand. Located in the Nutana community, this space will become the new home for independent bookstore Turning the Tide and provide coworking and meeting space for community organizers and grassroots organizations. Money raised will go towards renovation and equipment expenses with additional funds going towards initial operating costs and an organizing fund to support new community organizations.

Kudos! Speaking of crowdfunding, you may remember that Affinity Credit Union ran a social enterprise contest last fall that combined traditional grant making with a crowdfunding approach that raised over $90,000. That success was recently recognized with a National Credit Union award for Community Economic Development from Credit Union Central of Canada. Congrats to Affinity’s community development team – looking forward to this year’s contest!

And just in case you need a laugh, Vu Le over at Nonprofit With Balls provides some great templates to answer that perennial grant application question: how will your program be sustainable after our funding ends? The “poetic existential” and “short and simple” versions at the end are my favourite, but I have to give bonus points for including bunnyhugs2 in the Canadian version!

  1. Full disclosure: I was a volunteer presenter at one of Next Up’s sessions this past year.
  2. A Saskatchewan term for a hooded sweatshirt, or hoodie – I’m surprised that an American is familiar with a term, as I have never heard that term used elsewhere in Canada!