Categories big data

66 posts

Auto Added by WPeMatico

City Brain: Cloud Computing and Data Technology Help Our City Think Deeply

It takes HUMAN 100 years to process these data. It takes TECHNOLOGY one second to make our city a better place. On November 9, 2017, Dr. Wang Jian, Chairman of Alibaba Group’s Technology Committee, published an article in China’s mainstream media on the “City Brain”. In it, he explains that in […]

Legal and ethical implications of data accessibility for public welfare and AI research advancement

This article has been co-written with Gabrielle Paris Gagnon, lawyer at Propulsio 360 Business Consultants LLP Every organization that focuses on artificial intelligence wants and needs the same thing : more data to train their algorithms. Without a doubt, a lot of the success of deep learning systems today is predicated […]

Learning to analyze huge BigQuery datasets using Python on Kaggle

In this last few weeks I’ve learned how to analyze some of BigQuery’s cool public datasets using Python. If you’re not familiar, BigQuery makes it very easy to query Terabytes amounts of data in seconds. In this post, I’m going to share some tips and tricks for analyzing BigQuery data using […]

The data-driven corporation

The components of the data-driven culture picture: pixabay Modern companies are typically overloaded with large volumes of heterogeneous data, from multiple sources. They make significant investments on technologies and architectures such as data marts, data warehouses, data lakes and operational data stores with sophisticated Business Intelligence, Analytics and Predictive systems on top. […]

Setting Your Seed Value with Sparklyr

A few months ago, I gave a rather ambitious presentation on reproducible research. Part of this presentation included demonstrating how to analyze data on a Spark cluster using R with the Sparklyr package. When you train as a data scientist, one of the first things you learn is to set a […]

Simplifying The Analytic Process — TAP #12

The Transmogrification Of Your Data… Hidden In Plain Sight If you’ve been following along in the series, you know that we use an (I) to indicate the information phase of The Analytic Process (TAP). You also know that each of our phases has its own letter. You could say we are […]

Big Data: What is Web Scraping and how to use it

What is web scraping? It is essential for gathering Big Data sets, which are the cornerstone of Big Data analytics, Machine Learning (ML) and tutoring the Artificial Intelligence (AI) algorithms. The hard point is that information is the most valuable commodity in the world (after time, as you cannot buy […]

Artificial Intelligence and Data Science are changing Crime Investigation and Prevention

by Omkar Sabnis and Sukant Khurana Photo by Simon Wijers on Unsplash Crime in the world is advancing as technology advances. As we have all read the news the crimes have evolved with technology and time. It has evolved from bank robberies to hacking the bank to send the money to another […]

Few futuristic ways AI and big data can convert law-breaking regions of traffic start following…

Few futuristic ways AI and big data can convert law-breaking regions of traffic start following traffic rules by Saikat Bhattacharyya and Sukant Khurana Photo by mauro mora on Unsplash Things have changed since 1912, when Lester Wire developed the first traffic light, hoping that it would signal pedestrians and vehicles alike to follow […]

The Emergence of Artificial Intelligence

A couple of weeks ago, Google CEO Sundar Pichai told an audience at a Recode-sponsored event that for humanity, the impact of artificial intelligence could be “more profound than, I dunno, electricity or fire”. In this article, I will explore how artificial intelligence emerges from data and algorithms, and how […]