ICTworks

Recently, MERL Tech Jozi, our first MERL Tech on the African continent, brought together a wide range of experts for two days of sharing, learning and exploring what’s happening at the intersection of Monitoring, Evaluation, Research and Learning (MERL) and technology.

Register Now for MERL Tech DC on September 6-7, 2018

Participants spanned backgrounds and types of institutions – one of the things that makes MERL Tech unique – and it was really exciting to learn about the work that is happening in South Africa and nearby countries.

The conference vibe was energetic, buzzy and friendly, with lots of opportunities to meet people and discuss this area of work. Thanks to all our sponsors – Genesis Analytics, Praekelt.org, The Digital Impact Alliance (DIAL) and JoziHub!

Tech Savvy Newcomers vs. Established Evaluators

One key take-away for me was that there’s a gap between the ‘new school’ of younger, more tech savvy MERL practitioners and the more established, older evaluation community.

Some familiar tensions were present between those with years of experience in MERL and less expertise in tech and those who are newer to the MERL side yet highly proficient in tech-enabled approaches. The number of people who identify as having skills that span both areas is growing and will continue to do so.

It’s going to be important to continue to learn from one another and work together to bring our MERL work to the next level, both in terms of how we form MERL teams with the necessary expertise internally and how we engage with each other and interact as a whole sector.

As one participant put it, we are not going find all these magical skills in one person — the “MERL Tech Unicorn” so we need to be cognizant of how we form teams that have the right variety of skills and experiences, including data management and data science where necessary.

Increasingly, evaluations require research, eval, tech & sector experience. Helping Evaluators to build networks with data scientists or survey- & other tech experts, is a better capacity dev strategy than trying to get know-it-all Evaluators — Benita Williams

It is critical that we all have a better understanding of the wider impacts of technologies, beyond our projects, programs, platforms and evaluations.

• If we don’t have a strong grip on how technology is affecting wider society, how will we understand how social change happens in increasingly digital contexts?
• How will we negotiate data privacy? How will we wrestle with corporate data use and the potential for government surveillance?
• If evaluator understanding of technology and the information society is low, how will evaluators offer relevant and meaningful insights?
• How do diversity, inclusion and bias manifest themselves in a tech-enabled world and in tech-enabled MERL and what do evaluators need to know about that in order to ensure representation?
• How do we understand data in its newer forms and manifestations?
• How do we ensure ethical and sound approaches?

We need all the various sectors who form part of the MERL Tech community work together to come to a better understanding of both the tangible and intangible impacts of technology in development work, evaluation, and wider society.

What questions should evaluators ask about technology? How can the tech forerunners bring the crowd with asks Victor Naidu from SAMEA

We Need to Develop MERL Tech Skills for Evaluators

A second takeaway, as highlighted by Victor Naidu from the South African Monitoring and Evaluation Association (SAMEA), is that we need to focus on developing the competencies that evaluators require for the near future. And we need to think about how the tech sector can better serve the MERL community.

SAMEA has created a set of draft competencies for evaluators, but these are missing digital competencies. SAMEA would love your comments and thoughts on what digital competencies evaluators require. They would also like to see you as part of their community and at their next event! (More info on joining SAMEA).

What digital competencies should be added to this list of evaluator competencies? Please add your suggestions and comments to the Google Doc.

MERL Tech will be collaborating more closely with SAMEA to include a MERL Tech Track at SAMEA’s 2019 conference.

We Need MERL for ICT4D

A third key takeaway is that we need to do a better job of documenting and evaluating the use of technology in development and in MERL (e.g., the MERL of ICT4D and MERL of tech-enabled MERL).

I learned so much from the practical presentations and experience sharing during MERL Tech Jozi. In many cases, the challenges and learning were very similar across projects and efforts.

• We need to find better ways of ensuring that this kind of learning is found, accessed, and that it is put into practice when creating new initiatives.
• We need to also understand more about the power dynamics, negative incentives and other barriers that prevent us from using what we know.

As MERL Tech, we are planning to pull some resources and learning together over the next year or two, to trace the shifts in the space over the past 5 years, and to highlight some of the trends we are seeing for the future.

Please get in touch with me if you’d like to participate in this “MERL of MERL Tech” research with a case study, an academic paper, other related research, or as a key informant!

Register Now for MERL Tech DC on September 6-7, with pre-event workshops on September 5 on Big Data and Evaluation and Blockchain and MERL!