Category: strategy

Being Responsible About Research

Posted on | by Elizabeth Weaver Engel, CAE

In this final post celebrating the launch of Caveat Emptor: Becoming a Responsible Consumer of Research, I want to talk about why this matters.

Why do association execs need to develop discernment about research, both as consumers and sponsors? Why do you need to have at least some familiarity with research terms? Why do you need to understand the benefits and drawbacks of various types of research methods?

Quoting from the monograph:

It’s important for associations to get this right, both so that association executives have the best possible chance of making good decisions about how to invest limited association resources to generate the best return for members, and because associations are viewed as trusted, unbiased sources of information for the members and other audiences we serve. It’s incumbent on us to provide quality research products so we remain worthy of that trust.

As a reminder, the whitepaper also includes:

  • An interview with Dr. Sharon E. Moss, co-editor (with Sarah C. Slater) of The Informed Association: A Practical Guide to Using Research for Results, on ethical practices in research.
  • An interview with Dr. Joyce E. A. Russell, The Helen and William O’Toole Dean at Villanova School of Business, on developing discernment in assessing research.
  • An interview with Jeff Tenenbaum, Managing Partner at Tenenbaum Law Group PLLC, on avoiding antitrust liability.
  • Case studies with the American Association of Colleges of Pharmacy, the Association of American Medical Colleges, the Casualty Actuarial Society, and IEEE.
  • A plain English review of key research terms, and a brief explanation of the rules of formal logic (and how they affect research work).
  • Recommendations for books, articles, websites, podcasts, and courses you can use to improve your research skills.
  • A series of thought questions for you to use to spark discussion with your team.
  • An extensive list of resources in case you want to dig deeper on any of the topics addressed.

My co-author Polly Karpowicz and I are in the process of arranging additional opportunities to learn more, including a webinar with Association Insights in Old Town in April of 2023 – more information to follow.

In the meantime, get your free copy at https://bit.ly/3SYJiAO, no divulging of information about yourself required.

 

Curiosity with a Purpose

Posted on | by Elizabeth Weaver Engel, CAE

As Zora Neale Hurston described it:

Research is formalized curiosity. It is poking and prying with a purpose.

When you’re sponsoring a research study, one of the biggest decisions you’ll have to make is what method(s) to use.

What are your choices?

  • Quantitative v. Qualitative
  • Primary v. Secondary

You also have some decisions to make about data collection. The choices there include:

  • Formal v. Informal
  • Active v. Passive

All of these choices have associated pros and cons.

For instance, surveys (quantitative primary research where the data collection is active and formal) provide numeric answers that can be described by levels of statistical significance and degrees of confidence (see yesterday’s post for more on that). That’s obviously a pro.

On the con side, because surveys provide reassuringly specific answers, it’s tempting to over-rely on them. They’re also more susceptible to design flaws that can introduce bias – and once the survey’s deployed, you can’t correct those errors without invalidating all the responses that have already come in.

So what’s the answer?

Download the new Spark collaborative whitepaper Caveat Emptor: Becoming a Responsible Consumer of Research to find out!

“P-Value”? What’s a “P-Value”?

Posted on | by Elizabeth Weaver Engel, CAE | 1 Comment on “P-Value”? What’s a “P-Value”?

And why should you care?

Associations generate a lot of original research, but association execs also use a lot of research created by other entities both to assess the internal operations of the association as a tax-exempt business and to understand what’s happening in the industry or profession the association serves.

And let’s face it: Lots of research terms are pretty jargon-y. P-values and margin of error and confidence interval and representative versus purposeful samples, oh my!

It’s easy to find yourself glazing over in the methods section of the study you’ve chosen, ignoring it all together, or just deciding not to worry about what it reports.

That would be a mistake.

All those things directly affect the validity of the study and the results presented, results which we use every day to make decisions for our associations and the professions and industries we serve.

Quoting the new Spark collaborative whitepaper Caveat Emptor: Becoming a Responsible Consumer of Research:

Good research does not guarantee good decisions, but it certainly helps. And bad research, barring getting lucky and guessing right, almost inevitably leads to bad decisions.

We want you to have everything you need to make good decisions, so in Caveat Emptor, my co-author Polly Karpowicz and I provide plain English explanations of key terms in research design so that you can build your information literacy muscles and choose wisely what research you will – and won’t – trust.

Get your free copy at https://bit.ly/3SYJiAO, no divulging of information about yourself required.

 

Lies, Damn Lies & Statistics?

Posted on | by Elizabeth Weaver Engel, CAE

Association execs consume – and produce – a lot of research in our day-to-day work, but most of us don’t have formal training in research. A lot of the language of research programs– p-values and confidence intervals and margins of error – can be pretty jargony, and some of the concepts behind what makes for good (or less good) research can be challenging for people who haven’t had the opportunity to take a graduate level methods course.

How can you be sure that the research you’re using or sponsoring is giving you the insight you need to make good decisions? How can you protect your association’s reputation as a trusted source of unbiased information for the profession or industry you serve?

In the latest Spark collaborative whitepaper, Caveat Emptor: Becoming a Responsible Consumer of Research, Polly Karpowicz, CAE and I tackle the sometimes thorny issue of what you need to know to be a savvy consumer and sponsor of research even if you DON’T have a formal background in research methods or much formal training (which, let’s be honest, most of us don’t).

The whitepaper also includes:

  • An interview with Dr. Sharon E. Moss, co-editor (with Sarah C. Slater) of The Informed Association: A Practical Guide to Using Research for Results, on ethical practices in research.
  • An interview with Dr. Joyce E. A. Russell, The Helen and William O’Toole Dean at Villanova School of Business, on developing discernment in assessing research.
  • An interview with Jeff Tenenbaum, Managing Partner at Tenenbaum Law Group PLLC, on avoiding antitrust liability.
  • Case studies with the American Association of Colleges of Pharmacy, the Association of American Medical Colleges, the Casualty Actuarial Society, and IEEE.
  • A plain English review of key research terms, and a brief explanation of the rules of formal logic (and how they affect research work).
  • Recommendations for books, articles, websites, podcasts, and courses you can use to improve your research skills.
  • A series of thought questions for you to use to spark discussion with your team.
  • An extensive list of resources in case you want to dig deeper on any of the topics addressed.

I’ll be blogging about the whitepaper more in the coming days, highlighting some of our major findings, but in the meantime I invite you to download your free copy at https://bit.ly/3SYJiAO – we don’t collect any data on you to get it, and you won’t end up on some mailing list you didn’t ask for. We just use the bit.ly as an easy mechanism to count the number of times it’s been downloaded.

And don’t forget to check out some of the other FREE Spark collaborative whitepapers, too, on topics ranging from content curation to digital transformation, blockchain, DEI, lean startup, member-centric engagement, and more!

Influence Across America

Posted on | by Elizabeth Weaver Engel, CAE

Thanks to the generosity of my friend and colleague Ed Barks, I had the opportunity to attend Influence Across America: The Rise of State and Local Power and the Impact of Digital Media, a National Digital Roundtable panel event at the Newseum earlier this week.

Panelists shared some interesting and disturbing statistics, as well as good advice for breaking through the noise and getting local and national media attention for your organization’s signal.

First the stats (all from Pew):

  • 2019 will be the first year digital ad spending outpaces ad spending in traditional media.
  • Facebook and YouTube are still the top social platforms overall, but among 18-24 year olds, it’s Snapchat and Instagram.
  • Facebook and Google VASTLY dominate digital ad spending. Nothing else is even close.
  • Lots of people of all ages get their news partially or mostly online, but the demographic generation with the biggest growth is Boomers.
  • 71% of people think their local newspaper is doing fine financially. Only 14% of people pay for local news. (You would think that would cause at least some of them some cognitive dissonance, but apparently not. People: NEWS IS NOT FREE.)

Where do people prefer to get their news?

  • 41% – TV
  • 37% – online
  • 13% – newspaper
  • 8% – radio

(It’s official – my NPR-listening, print Washington Post-subscribing self is a big weirdo.)

Now for the advice:

The Kellogg Foundation produces an event called the National Day of Racial Healing, which takes place in January each year, in conjunction with the Martin Luther King holiday. They saw the highest social/online engagement from cities where they also had the most in-person events. Lesson? In-person events and social/digital campaigns reinforce each other. They were also to recruit a big-name influencer – Ava DuVernay – to support and amplify the campaign, because this is part of the work she does on a daily basis. Lesson? You can attract celebrity help if you choose wisely.

Zero To Three (a Spark client!) used the See-Say-Do model to organize their efforts and set goals.

  • See = impressions, reach, awareness
  • Say = engagement, likes, shares, influencer attention
  • Do = call to action (for them, it was to join their public policy alert network)

The Elizabeth Dole Foundation also had success attracting a big-name influencer for their Hidden Heroes campaign, which highlights and supports the work of caregivers for wounded veterans – Tom Hanks. Again, the lesson is to look for alignment between a celebrity’s interests and work and your cause. The Dole Foundation also has a real advisory group that fully sets the agenda for their work, which has led to a focus on working with cities (130 so far) to find local resources, support, and recognition for caregivers.

The advisory group also led the Foundation to take a more “playful” tone on their social media platforms and to be genuinely interactive, as opposed to just shouting marketing messages at their audiences (something many associations are still guilty of). They also focus on telling the stories of caregivers, and provide camera-ready resources for their ambassadors – literally, because they’re realized that Instagram is the right focus platform for their audience, which is largely mid-20s through mid-50s women.

The panel featured:

  • Angela Greiling Keane, Deputy Managing Editor – States, POLITICO & Former President, National Press Club
  • Ernestine Benedict, Chief Communications Officer, ZERO TO THREE (State of Babies)
  • Madison Moore, Director of Strategic Initiatives, Elizabeth Dole Foundation (Hidden Heroes)
  • Howard M. Walters, Program and Evaluation Officer, W. K. Kellogg Foundation (National Day of Racial Healing)
  • Dr. Nii-Quartelai Quartey, Senior Advisor and National LGBT Liaison, Community, State & National Affairs, Multicultural Leadership, AARP
  • Anthony Shop, Co-Founder, Social Driver & Chairman, National Digital Roundtable (moderator)
  • Barbara McCormack, Vice President of Education, Freedom Forum Institute (host)

 

Catch Spark at #ASAE16

Posted on | by Elizabeth Weaver Engel, CAE

I’ll be presenting two sessions at the upcoming ASAE Annual Meeting in Salt Lake City in a I'm Speaking ASAE 2016 Annual Meetingfew weeks:

  • Unsession: The Association Role in the New Education Paradigm, Sunday, August 14
  • Deep Dive: The Lean Startup Changes Everything, Tuesday, August 16

For the unsession, join me and Shelly Alcorn (Alcorn Associates) for a town hall-style discussion of how associations are being impacted by and can in turn impact trends in education and employment. Both of these sectors are undergoing profound disruption, and we believe associations are uniquely positioned to play a vital role in helping our current and future stakeholders adjust and even thrive in this rapidly changing environment.

In this unsession, we’ll share a preview of our soon-to-be released whitepaper, The Association Role in the New Education Paradigm (yep, the next Spark white paper is about to drop, y’all!). We’ll highlight some of the latest research on this topic, identify what we see as association advantages in these areas, and share the stories of associations that are doing good work preparing their audiences for the future.

We plan to challenge your thinking about the role associations can play in bridging the education to employment gap. We’ll have some questions for you, and we hope you’ll have some for us. Our goal is to have a productive dialogue that opens all of our eyes to some new possibilities for benefitting our members, our other stakeholders, and society at large.

We’ll be in one of the pop up session pods, probably around 3:30 Sunday afternoon.

For the Deep Dive session, join me and Guillermo Ortiz de Zarate (National Council of Architectural Registration Boards) for a full 90 minute session on lean startup methodology.

There’s no bigger waste than investing resources working on the wrong thing. Lean startup is a development approach that requires articulating and testing assumptions, favors rapid experimentation over elaborate planning, relies on customer feedback over intuition, and encourages iterative design, all in the service of ensuring you’re investing in the right thing.

It’s based on our October 2015 white paper Innovate the Lean Way: Applying Lean Startup Methodology in the Association Environment, and because we have a deep dive session, we’ll have time to work through a multi-part exercise, using the lean canvas, where attendees will get to work with lean concepts like the MVP, The One Metric That Matters, and the Pivot, so you can learn to apply this technique in your own organization to eliminate waste, validate your learning, and innovate faster and more successfully.

The deep dive session will be in Salt Palace room 255E from 9 – 10:30 am on Tuesday.

Seven Keys to Marketing Success

Posted on | by Elizabeth Weaver Engel, CAE

Recently, on ASAE’s Collaborate Community, someone asked for examples of other Key to successassociations’ marketing plans. The things is, marketing plans are less about taking some other organization’s plan and swapping your acronym for theirs and more about answering some key questions:

  1. What do you know about your audiences? Who are they, who are the key decision makers, what and how and when do they buy, etc.? (Capture EVERYTHING you know and always look to be adding.)
  2. What are you trying to market to them? Make sure you’re clear about your program, product, or service and can describe it in benefits to your audience, not in features you offer.
  3. What are your goals? Remember, they should be SMART (specific, measurable, attainable, realistic and timely).
  4. Do you have any competition? If so, what do you know about them?
  5. What assets do you have at your disposal (website, email, direct mail, social media, in person events, etc.), and how do you plan to use them? This is the place where you set your strategies and match tactics to them.
  6. What’s your budget? Don’t forget to think about staff time as well as money.
  7. How will you know you’ve been successful? What will you be tracking and monitoring, and how will you do it and report on it, and to whom, and on what interval?

Image credit: Dr. Mommy

Don’t Forget the Debrief!

Posted on | by Elizabeth Weaver Engel, CAE

Sometimes I think the most useful service I perform as a consultant has nothing to do with Thumbs up/thumbs downconducting stakeholder interviews or running focus groups or digging through background materials or doing secondary research or creating kick-ass strategies or even more kick-ass campaigns or teaching staff what’s involved in conducting a campaign so they can go forth and fish themselves, rather than just eating the fish sandwich I handed them.

Not that all that stuff isn’t great, of course, but I think maybe the most helpful thing I do for clients is get them to sit down for an hour or two after we finish whatever the main focus of the engagement was, discuss what we learned, talk about what we’d do differently the next time, and document the whole thing. In order to do this, we also have to actually figure out what happened. We go through questions like:

  • In concrete and specific terms, how did we do against what we wanted to do? Did we achieve the revenue (or number of attendees or number of new members or renewal percentage etc….) we were aiming at? Why or why not?
  • What went well? How can we tweak it to make it go even better next time?
  • What didn’t go well? Why? Should we try to fix it next time, and if so, how, or should we just write it off as an experiment that didn’t work?
  • Is there anything we wanted to do we didn’t get to or couldn’t make happen, and what did we learn that would get us there next time?

It’s hard, I know. When there’s a lot going on and not quite as many people as you wish you had to get it all done, it’s tempting to finish a project and just move on the next thing on the “To Do” list.

The problem with that is that we want our associations to be learning organisms. But if you never take the time to assess what happened and capture and share what you learned, your association will never get smarter as an organization – you’ll never get to the point where you’re increasing organizational capacity.

Image credit: Freepsdfile.com

 

The Consultant and the Association Exec Should Be Friends

Posted on | by Elizabeth Weaver Engel, CAE

Eons ago (actual time: four years), I wrote two blog posts on the topic of consulting and RFPs. They’re still among my most popular posts ever.

I got thinking about this topic again recently for a few reasons:

  • I just got my shiny new ASAE Buyers’ Guide, which includes an article on the RFP process.
  • There’s been some chatter lately on some of the Collaborate communities about the RFP process.
  • I just submitted a proposal in response to an RFP that asked for my “project management methodology,” aka, my approach to managing the consultant/client relationship (which I thought was a damn fine question).

As the title of this post states, the consultant and the association executive should be friends (bonus points if you get the Oklahoma! reference). One side has expertise to offer, the other side needs that expertise periodically (but not continuously, which is why you’re hiring a consultant rather than another staff person), what’s the problem?

The problem, often, is that we fail to follow the golden rule. Rather than treating each other as we ourselves would want to be treated, we behave badly.

Consultants can be overly aggressive and too “sales-y.” We are sometimes guilty of hounding execs, acting boorish, discounting organizational culture, and being far too convinced of our own brilliance.

Association execs have been known to issue “spray & pray” RFPs to everyone under the sun, a huge waste of time and energy on both sides. They waffle. They refuse to talk to consultants and withhold information. Some of them have been known to steal consultants’ intellectual property, or give (higher priced) Consultant A’s (perhaps overly detailed) proposal to (lower priced) Consultant B to implement.

People! We have to work together here!

And that’s that point: the consulting relationship is just that – a relationship. A partnership. The proposal process is like getting dating. Signing the contract is like getting married. And you both want your marriage to work, right?

Consultants provide a lot of the intellectual capital in association management, some of it for free, some of it for pay. Association execs are our clients, and our partners in creating change. And both sides are vital members of the community we all love. Because, as Jamie Notter is fond of reminding us, it’s all about love.

Or to quote myself, from that ancient RFP blog post:

What’s the common theme? Relationship. We’re about to enter into a relationship. You don’t start a dating relationship by refusing to talk to the other party, withholding information, and putting them through a lot of silly, unnecessary tests (and if you do, odds are you’re single), and you don’t want to start a consulting relationship that way, either.

 

 

Novelty for Novelty’s Sake

Posted on | by Elizabeth Weaver Engel, CAE

As associations, we have to be wary of “we have always done it that way.” And if you read this blog regularly, you know that I rail against unwillingness to change pretty frequently. I would count myself as strongly pro asking new questions, proposing new ideas, and coming up with new ways of doing things.

But.

I think we also have to watch out for changing gears just for the sake of changing gears. Sometimes, we’re too quick to dump things that are working.

I’m not saying rest on your laurels, get stale, and never ask any questions about how you can improve. If something is working well, there’s almost always a way to make it work even better. We should always be looking for opportunities to expand, improve, tweak, test, and learn to see if we can get better results.

But we also need to be make sure we don’t throw out effective campaigns or programs or services just for the sake of novelty.