A Tale of Two Disciplines: Data Scientist and Business Analyst

data scientist and BA

The ability to use data to achieve enterprise goals requires advanced skills that many organizations don’t yet have. But they are looking to add them – and fast. The question is, what type of big data expert is needed? Does an organization need a data scientist or does it need a business analyst? Maybe it even needs both. These two titles are often used interchangeably, and confusion abounds.

Business analysts typically have educational backgrounds in business and humanities. They find and extract valuable information from a variety of sources to evaluate past, present, and future business performance – and then determine which analytical models and approaches will help explain solutions to the end users who need them.

With educational backgrounds in computer science, mathematics, and technology, data scientists are digital builders. They use statistical programming to actually construct the framework for gathering and using the data by creating and implementing algorithms to do it. Such algorithms help businesses with decision making, data management, and the creation of data visualizations to help explain the data that they gather.

Read more at A Tale of Two Disciplines: Data Scientist and Business Analyst

Share your opinions in the comment box below and subscribe us to get updates in your inbox.

Automating Big-Data Analysis and Replacing Human Intuition with Algorithms

A new and unique computer system from MIT has outperformed human intuition using its algorithms, and it’s amazing, and perhaps a little frightening: the Data Science Machine beat out over 600 human teams in finding predictive analysis.

Big-data analysis consists of searching for buried patterns that have some kind of predictive power.

But choosing which “features” of the data to analyze usually requires some human intuition.

In a database containing, say, the beginning and end dates of various sales promotions and weekly profits, the crucial data may not be the dates themselves but the spans between them, or not the total profits but the averages across those spans.

MIT researchers aim to take the human element out of big-data analysis, with a new system that not only searches for patterns but designs the feature set, too.

To test the first prototype of their system, they enrolled it in three data science competitions, in which it competed against human teams to find predictive patterns in unfamiliar data sets.

Of the 906 teams participating in the three competitions, the researchers’ “Data Science Machine” finished ahead of 615.

In two of the three competitions, the predictions made by the Data Science Machine were 94 percent and 96 percent as accurate as the winning submissions.

In the third, the figure was a more modest 87 percent. But where the teams of humans typically labored over their prediction algorithms for months, the Data Science Machine took somewhere between two and 12 hours to produce each of its entries.

Read more at Automating Big-Data Analysis and Replacing Human Intuition with Algorithms

Share your opinions with us in the comment box. Subscribe to get updates in your inbox.