Era of big data moves into realm of action and ethics - SiliconANGLE

With big data and its consequences being very much in the news this year, the conversation around the handling of information streams is turning toward issues like privacy and bias. The big data era has moved from the technical requirements, such as ingestion and storage, and into the realm of action, where enterprises need to put data to use with confidence that it will generate an unbiased outcome.

“How do we do privacy? How do we maintain the right level of data so we don’t have bias? How to we get diversity going?” asked Maribel Lopez (pictured), founder and principal analyst at Lopez Research LLC. “The next wave is around understanding how to use your data, understanding how to get third-party data in and being able to rapidly make decisions and change models based on that.”

Lopez spoke with Lisa Martin (@LuccaZara), host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, at the BigData SV event in San Jose, California. They discussed the importance of data ethics and how larger companies are working to provide the right machine learning tools that avoid bias.

As companies rely more heavily on actionable data using tools such as artificial intelligence and machine learning, some organizations are beginning to explore codes of conduct and ethics guidelines for how data will be analyzed and used. Last fall, Bloomberg LP formed a partnership with BrightHive and Data for Democracy to develop a code of ethics for data scientists.

“We have to be really thoughtful about what we put into the system,” Lopez said. “We assume at some point the machines are going to start making decisions for us, and we want to make sure that they have the best information to do that and they don’t limit our opportunities as a society.”

As the data science landscape has evolved, companies are relying on vendors, including cloud providers like Amazon or Microsoft, to provide entry-level tools for business information analysis. “If you’re Microsoft, Google or Amazon, you’re trying very hard to make sure you’re giving tools that have the right ethics in them and can help kickstart peoples’ machine learning efforts” Lopez said. “I think that’s going to be a real win for us.”

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the BigData SV event.

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.   The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content. If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE: