It’s an understatement that great leadership is challenging and rare. And leading data science teams has unique challenges: Stakeholders might get disillusioned by your team’s inability to deliver magic The battle to recruit and retain data science talent is fierce Data science’s ethical dilemmas are particularly perplexing There is not an agreed-upon process for managing […]
During the past month, we conducted at poll to see what project management framework teams used to help execute their data science projects. Based on our survey of 109 respondents, CRISP-DM was the most commonly used data science process framework (it was used by about half the respondents). This was followed by Scrum, Kanban and “my […]
A data science workflow defines the phases (or steps) in a data science project. Using a well-defined data science workflow is useful in that it provides a simple way to remind all data science team members of the work to be done to do a data science project. One way to think about the benefit […]
The battle between Data Science vs Software Engineering isn’t really a battle. Rather these are two somewhat overlapping and complementary fields that are similar in many ways. However, dig deeper, and you’ll find key differences: Data science is more exploratory. Software engineers are more focused on systems building. And data science project management should be […]
How do you effectively define a data science process? Conceptually, a data science process explains and defines how a team should execute a project. Having a robust, repeatable process helps to ensure that the project efficiently and effectively delivers actionable insight. In this article, I’ll explore how to create a well-defined data science process in […]
So are there new emerging approaches that are data science native? Microsoft’s Team Data Science Process (TDSP), Domino Data Lab’s Data Science Life Cycle, and the Data Science Process Alliance’s Data Driven Scrum (DDS) are approaches that are both data science native and agile. There are pros and cons specific to each approach but they share some fundamental principles.
Can you mix and match elements of multiple project management approaches? Of course! This post explores two such general hybrid approaches for data science:agile-waterfall and research and development.
Agile has taken the software community by storm with Scrum and Kanban leading the way. What are these approaches and do the fit in the world of data science?
How do you manage data science projects? Is it software? Is it research? Or maybe, simply magic? This four-part post is an overview 10 ways projects are or could be managed. To start, we’ll explore ad hoc project management, waterfall, and CRISP-DM.
While there is no standard process for a team to use when working on a data science project, CRISP-DM (CRoss-Industry Standard Process for Data Mining) is one framework that is often considered for data science projects. Perhaps because of this, there are lots of web sites describing the 6 phases of a CRISP-DM project, and […]