Bringing user research into planning a new analytics platform

Director of Design

Led the UX team (two designers) across Germany and New York, as a functional head alongside product and engineering

For five years I was Director of Design at Datameer, a collaborative data analytics platform used at top US, Canadian and UK banks and insurers. When the company bet on a new product, design went from an execution-focused function to a strategic partner, with executive support for user research. I led the UX team, and design and user research for the new platform from concept to release.

A new-product bet brought research and design into the roadmap

The setting
Datameer, a collaborative data analytics platform for highly regulated industries, including top US, Canadian and UK banks and insurers. The company kept its existing product and went after a new one.
My part
Director of Design, 2016 to 2021. I led the UX team, two designers across Germany and New York, and led design and user research for the new collaborative data platform from concept to product release.
What changed
Research got budget and executive support, design entered roadmap conversations, and the design system got built.
Three takeaways
Tie research to the bet your company is already making. Give every hard-to-reach user a route. Track which decisions design is part of.

Dense screens, expert users, and design on execution

The platform's screens were dense: column charts, pivot tables over big data, aggregated JSON views, result cards and a filter system for exploring data. The people working in them ranged from business users and data analysts to data engineers who wrote their own queries. They were sophisticated in data analytics without being software developers.

The existing Datameer platform's spreadsheet view: a formula bar with a CASE expression, a table of tokenized street addresses with 1000 rows, a column inspector listing the sheet's formulas, and a row of sheet tabs along the bottom.
Fig. 01

The existing platform: a spreadsheet over big data, with formulas, an inspector for every sheet and many sheets per workbook. From a 2020 design file of the product.

Many of them worked at top banks and insurers in the US, Canada and the UK. Design's part in building those screens was execution.

Buying software did not mean using it

Datameer's bank and insurer customers had bought the platform. Buying software did not mean using it. It is the same pattern I see with AI today.

This study is about the part that comes before use: who gets to decide what the product will be, and how research and design came to be part of that decision.

The users were hard to reach, and the company was changing course

Research with these users meant working around access limits, because banking and insurance are regulated industries. By default, design also sat apart from sales, with occasional sales support.

Then the company's course changed. Datameer kept its existing product and business, but it saw the market shifting and wanted to launch a new product that met new market demands.

The new product needed research and design where it was decided

The new product needed research and design in the room where it was decided. That is what changed design's role. Research got budget and executive support, design entered roadmap conversations, and the design system got built.

I led design and user research for the new collaborative data platform, built from scratch, from concept through to product release.

One problem from that work: a preview that came back empty

Big data analytics ran on sampling. A query builder preview could show empty results even when the full data held matches.

Diagram: a query against the full dataset finds matches, while a preview built from a small sample can miss all of them and report nothing. That is a property of sampling, not a bug. View full size ↗
Fig. 02

Why a sampled preview can report nothing while the data is there.

I experimented with different sampling approaches and user feedback mechanisms. The design that solved it gave visual and text feedback on sampling status, so users understood the limits of a preview against the results of the full query.

Design in the roadmap conversations, and a design system to build with

The record of the change is the sequence: a new product bet, research with budget and executive support, design in the roadmap conversations, and a design system that got built.

Design's role
Execution-focused function Strategic business partner, in the roadmap conversations
User research
Budget and executive support; in person with US customers, a research trip with sales, and remote screening on usertesting.com
The new platform
Design and user research led from concept through to product release
Design system
Co-built, with components such as data-table column headers and inspector panels; I led its implementation across the design team and engineering

The charts and pivot tables stayed dense

The screens were still column charts, pivot tables and result cards for people who knew their data. What changed sat upstream of them.

Research with the people using the platform had executive support, and design sat in the conversations where the roadmap was set.

Getting design into the roadmap conversation

  1. Tie research to the bet your company is already making.

    At Datameer, executive support for research came with a new product bet. Name the decision on your roadmap that research would change. If you can't, the request for budget isn't ready.

  2. Give every hard-to-reach user a route.

    Regulated customers limit access, so one method rarely covers everyone. List your personas and the route to each: in person, alongside sales, or remote screening.

  3. Track which decisions design is part of.

    Write down which roadmap conversations design is in today, and which decisions research has fed. Review the list each quarter.

A settled roadmap needs a different argument

This path depended on a company deciding something new. Where the product and the roadmap are settled, research has no open decision to attach to, and the case for executive support has to rest on something else, such as the cost of a problem you can already see.

Want to hear more?

  • Bring me the product decision your company is about to make, and the users nobody on the team has watched at work yet. We can work out how to reach them before the roadmap is set.
Get in touch