The demands for data science insights and systems far outstrip the capacity for data science teams to deliver. How do you best balance this? Enter the Data Science Product Manager.
Unlike more tactical roles like the project manager who oversees the project life cycle or a process master who drives the data science processes, the data science product manager is more strategic. Wearing many different hats, the data science product manager plays an increasingly important role for organizations.
So let’s unravel this role:
- What is a data science product manager?
- What is a specific example of when a product manager was needed?
- What are 10 signs you need a product manager?
- Is the data science product manager a good role?
What is a Data Science Product Manager?
The evolution of the product manager
The product manager role was born out of consumer package goods (CPG) companies that assign specific brand managers to oversee everyday products like laundry detergent, baby powder, or sodas.
Within the past couple of decades, the software industry has adopted the role as someone to guide the development of software tools. Currently, it is almost a given that any sizeable software team has a product person. In Scrum, this role is known as the Product Owner who “is accountable for maximizing the value of the product resulting from the work of the Scrum Team” (see the Scrum Guide).
Roles & responsibilities
As data science teams mature, organizations are also hiring dedicated products managers to guide their data science product strategy. Common responsibilities include:
- Research data science industry trends
- Identify opportunities where advanced analytics, artificial intelligence, and machine learning can solve specific needs
- Develop a compelling product vision
- Set the product roadmap that clearly outlines the future releases and longer-term product strategy
- Prioritize work for the data science, data engineering, and advanced analytics teams
- Manage and articulate a product backlog of ideas
Don’t Miss Out on the Latest
Sign up for the Data Science Project Manager’s Tips to learn 4 differentiating factors to better manage data science projects. Plus, you’ll get monthly updates on the latest articles, research, and offers.
When a Product Manager was Needed
Mini Case Study — learn from my mistake
Jeff explained in his previous post on team roles that the data science product owner is needed for many teams. Yet, in some circumstances, one may not be needed. For example:
- Rigid contract arrangements where the customer is paying you to deliver a specific solution
- Smaller, less complex, or low-impact projects
- Research projects where a team is trying to prove out that a certain problem could be modeled
- When the end deliverable is a one-time analysis or otherwise not operationalized
A project without a product manager
I worked on a project with clearly defined requirements to deliver a daily-generated forecast file and a user-facing dashboard. The team consisted of two data scientists, one data engineer, one Tableau developer, two subject matter experts, and me (the project manager). None of us truly researched the underlying business problem but proceeded to follow (somewhat blindly) the pre-defined requirements with some guidance from the subject matter experts.
Sound familiar to a project you might have worked on? If so, you won’t be surprised to learn that we missed a key unstated requirement that rendered the final solution useless. In short, we failed.
A replacement project with a product manager
So, we opened another project. This time – learning from my past mistake – I first developed a deep understanding of the fundamental business problem with the main stakeholder and his analyst team, identified the root issues, and then proposed some initial product features to fill both the stated and implied needs.
In tandem, I worked with my data science development team to design a dynamic querying web app that generates on-demand forecasts based on the user’s filter selections. I had weekly conversations with the business team to iteratively define features and demo work completed.
After months, my team delivered the initial product, and today we continue to release features about every month. By stepping in to research and understand the business needs and by defining and owning the product roadmap, I avoided the pitfalls of the first project to ensure this second one was a success.
10 Signs You Need a Data Science Product Manager
There are many reasons why a data science product owner or manager is becoming more important for teams. Here’s ten:
1. The customer doesn’t understand what it needs
In the first project above, the business stakeholders defined requirements for a dashboard sitting on top of a forecast file when they really needed a dynamic querying and forecasting tool. Such problem-solution mismatch scenarios happen often because stakeholders tend to have only a partial view of data science (often involving a Tableau dashboard or some other tool they’re familiar with). Without a product manager to dig deeper and investigate what is truly needed, the ill-defined requirements might pass right on to the data scientist team who waste their and the stakeholders’ time building something that no one needs.
2. The customer expects a data science solution when it’s not feasible
Similarly, customers might think that a problem is solve-able with machine learning when for some reason (e.g. lack of data, legal/ethics issues) it might not be. Or if ML can solve the problem, often a simpler analytics solution is all that is needed. This is where the product manager can step in and set expectations that perhaps the data science team should first explore but not commit to the requested solution.
3. The customer can’t identify good use cases
On the flip side, the business probably cannot identify the best use cases for machine learning and artificial intelligence. Someone who understands data science and can work with the stakeholders and data scientists to design a solution is much better equipped to identify use cases and deliver a data science product.
4. The customer lacks the time and the skillset
Managing a size-able product can be a full-time job. If it is a side job for a business stakeholder (after all they have a business to run), the data science team may not get enough feedback or direction. Likewise, product management is a profession that requires a broad range of skills that the customer might lack.
5. The customer doesn’t know how to use the results
The nuances of model interpretation are often not understood by the customer, and data scientists might not be able to effectively set expectations or explain why the most “accurate” model might not be the best. A product manager who understands data science can better facilitate communication among the data scientists and stakeholders and help the business understand and use the results.
6. The data scientists don’t understand the business need
A common flip-side of the above scenario is that the data scientists don’t understand the business need for the product. By translating the business needs into a language the data scientists can understand and by explaining the “why” behind a product, the product manager focuses the team on value-delivery.
7. No one is balancing competing demands
A common fallacy is to treat the project sponsor as the only stakeholder. However, any sufficiently sized project has multiple stakeholders, each with competing demands. A good product manager understands these various competing demands, prioritizes development on the most important needs, and aligns the product with the broader organizational strategy.
8. Mis-timed launches cause problems
Kind of a sub-point of the above…If you wait for the best possible results, you’re probably delaying value delivery and stifling the product feedback loop. But if you deliver too early, you might adversely impact the business. Someone needs to make this call and it’s probably not the data scientists (who might want to perfect their work) nor the stakeholders (who might insist on a hard deadline for delivery that’s often too soon). Yet, an effective product manager can often guide an optimal timeline to deliver a series of small or low-accurate solutions first (perhaps for A / B testing) before the wider market launch.
9. Models need to be managed post-launch
Unlike traditional software that doesn’t need to be re-trained, data science products may often deviate from desired behavior over time. Someone needs to step in and manage the full product life cycle. This is generally recognized in software and is even more critical in data science.
10. Maybe you should be developing a product suite
A data science team is often called on to solve a specific problem for a specific department. Sometimes this is what is needed. However, often the same work that is going into one data science product might also have another use case for a different (or even the same) department. Take for example, a customer churn model. Yes, the retention department might request this, but this same model can likewise serve product development, marketing, sales, and other teams. A good product manager looks across organizational and market needs and incorporates these broader needs into the product roadmap.
Is the Data Science Product Manager a Good Role?
Yes. It’s a fun, challenging, and highly-rewarding position. As a data science product manager, you can drive the direction for a team and influence the cutting-edge strategy for an organization.
Market feedback agrees. In fact, this role sits at the intersection of Glassdoor’s #2 and #3 jobs in the USA for 2021.
|Rank||Role||Salary (Median Base)||Job Satisfaction||# Job Openings|
The role is still nascent. Many teams have yet to adopt the role of a data science product manager. But it is picking up steam. Google “data science product manager jobs” and you’ll find dozens of opportunities. Some of these might be listed in similar titles such:
- Data Science Product Owner
- Product Manager, Analytics
- Product Manager, AI and ML
- Data Product Manager
A product manager is not always needed, particularly for smaller, non-stakeholder focused projects that don’t deliver operationalized products.
But in many circumstances, the product manager can make the difference between failure and success. Other organizations like Microsoft likewise realized the critical need for product management when it hired Kurl DelBene to help Microsoft build its”AI factory” (hbr.org).
As data science continues to mature and become ever more integrated with operationalized systems, the role of the data science product manager is becoming more critical.
Data Science Process Alliance services: Data science projects have unique challenges. We recognize that which is why we:
- Offer the Data Science Team Lead course and certification
- Provide Enterprise consulting services specific to data science process improvement
- Publish research to advance the industry’s body of knowledge
Team Management Posts: This post is part of the series which includes posts where you can:
- Discover How to Lead Data Science Teams
- Learn about the 8 Key Roles for Data Science Team
- Understand the difference between Data Science and Software Engineering
- Assess 10 Ethical Questions to ensure you comply
- Explore how to apply CRISP-DM for Teams
- Get 5 Tips for Remote Data Science Teams
- Review Lessons from 20 Data Science Teams
- Know the pros and cons of Centralized vs De-centralized Teams
Curious? Read our White Paper
Learn the five unique challenges of data science projects and how to overcome them.
Get a grasp on CRISP-DM, Scrum, and Data Driven Scrum.
And understand how to leverage best practices to deliver data science outcomes.