Data Science

Amazon Redshift COPY command cheatsheet

Amazon Redshift COPY command cheatsheet

Although it’s getting easier, ramping up on the COPY command to import tables into Redshift can become very tricky and error-prone.   Following the accordion-like hyperlinked Redshift documentation to get a complete command isn’t always straighforward, either. Treasure Data got in on the act (we always do!) with a guide to demystify and distill all the COPY commands you could ever need... »

How to pick the right sample for your analysis

How to pick the right sample for your analysis

Unless we are lucky enough to have access to an entire population and the capacity to analyse all of that data, we have to make do with samples from our population to make statistical inferences. Choosing a sample that is a good representation of your population is the heart of a quality analysis, as all of the fancy statistical tricks in the world can’t make accurate conclusions from bad or biase... »

Investigating Data Scientists, their Skills and Team Makeup

Investigating Data Scientists, their Skills and Team Makeup

A new survey of 490 data professionals from small to large companies, conducted by AnalyticsWeek in partnership with Business Over Broadway, provides a look into the field of data science. Download the free Executive Summary of the report, Optimizing your Data Science Teams. Our world of Big Data requires that businesses, to outpace their competitors, optimize the use of their data. Understanding ... »

5 Surprising Skills Tomorrow’s Chief Analytics Officers Need to Develop

5 Surprising Skills Tomorrow’s Chief Analytics Officers Need to Develop

In 2013 McKinsey predicted a massive talent gap in the analytics and big data space. By 2018, they estimate the shortage will reach some 140,000-190,000 individuals with quantitative skill sets, and 1.5 million analytics-savvy management professionals. It’s apparent that today’s analytics experts are wise to strive for management and leadership positions, because there will probably be no shortage... »

10 US Graduate Education Opportunities for Aspiring Analytics Professionals

10 US Graduate Education Opportunities for Aspiring Analytics Professionals

Big data education has become big business. With projected massive talent gaps in the field of analytics, many professionals with and without quantitative backgrounds are choosing to complete graduate-level training. In response to this demand, universities worldwide are opening the doors to new programs. According to The New York Times, some dozens of academically-focused graduate programs have b... »

Redshift Data Loading Simplified

As the Big Data scene emerges, one of the most common problems experienced by data engineers and data scientists alike involves getting data from one system to import nicely into (and export from) another. Often times, these are NoSQL systems that need to talk to Postgresql, MySQL or other setups. As the problem relates to getting semi-structured data, at volume, into the very-structured data ware... »

Data Science 101: Interactive Analysis with Jupyter and Pandas

Data Science 101: Interactive Analysis with Jupyter and Pandas

This article was originally published on Treasure Data blog. In case you were wondering, the next time you overhear a data scientist talking excitedly about “Pandas on Jupyter”, s/he’s not citing the latest 2-bit sci-fi from the orthographically challenged! There are now a few cloud-based analytics infrastructures available out there, including the one from Treasure Data, which, being one of the e... »

7 Characteristics to Look Before Hiring a Data Scientist

7 Characteristics to Look Before Hiring a Data Scientist

Data is being collected in droves, but most of the time, people don’t know what to do with it. That’s why data scientists are hot commodities in the startup world right now. In fact, between 2003 and 2013, employment in data industries grew about 21 percent — nearly 16 percent more than overall employment growth. It’s a fairly new concept, but these people are so valuable because they unders... »

Skip to toolbar