Cloudera is building a new open-source storage engine called Kudu, sources say

EXCLUSIVE:

Big data company Cloudera is preparing to launch major new open-source software for storing and serving lots of different kinds of unstructured data, with an eye toward challenging heavyweights in the database business, VentureBeat has learned.

The storage engine, Kudu, is meant as an alternative to the widely used Hadoop Distributed File System and the Hadoop-oriented HBase NoSQL database, borrowing characteristics from both, according to a copy of a slide deck on Kudu’s design goals that VentureBeat has obtained. The technology will be released as Apache-licensed open-source software, the slides show.

Cloudera has had one of its early employees leading a small team to work on Kudu for the past two years, and the company has begun pitching the software to customers before an open-source release at the end of this month, a source familiar with the matter told VentureBeat.

From VentureBeat

Get faster turnaround on creative, more testing, smarter improvements and better results. Learn how to apply agile marketing at our roadshow in SF.

That source and others believe Kudu could present a new threat to data warehouses from Teradata and IBM’s PureData (formerly Netezza), and other vendors. It may also be used as a highly scalable in-memory database that can handle massively parallel processing (MPP) workloads, not unlike HP’s Vertica and VoltDB, the sources say. And one day Kudu — which works across multiple data centers with RAM and fast solid-state drives (SSDs) — could even play a part in backup and disaster recovery.

Cloudera declined to comment.

However Cloudera chooses to market Kudu, it’s clear that the software is a big step forward for the company, not only in the company’s efforts to outdo other Hadoop vendors, but also in its quest to become a prominent player in enterprise software.

Not that Cloudera is a nobody. It’s worth almost $ 5 billion, according to one recent estimate, it has considerable backing from Intel, and it’s been positioning itself as a competitor to much larger database companies, like IBM and Oracle. But the fact is, fellow Hadoop vendor Hortonworks has gained credibility after it went public last year, and Hadoop company MapR is still around, too.

Cloudera recently doubled down on the rising Apache Spark open-source big data processing framework, but Spark is something Cloudera has been working on for years. And a few months ago, Cloudera brought new Python capability to Hadoop, following its acquisition of DataPad last year. Those are important efforts, but Kudu is something entirely new, something that can give the company freshness as it grows toward an initial public offering.

So what is Kudu, then?

It’s “nearly as fast as raw HDFS for scans” and, at the same time, “nearly as fast as HBase for random access,” according to one slide from a presentation on Kudu’s design goals. But Kudu is not meant to be a drop-in substitute for HDFS or HBase. “There are still places where these systems will be optimal, and Cloudera will continue to support and invest in them,” a slide said.

Kudu could be used for time-series data, or real-time reporting, or model building, according to another slide.

And it’s important to note that Kudu isn’t a SQL query engine for pulling up specific data. Cloudera has Impala for that, and others have Hive for that. Kudu has an “early integration” with Impala, and Spark support is coming, according to a slide.

The Kudu application programming interface (API) works with Java — the common language of Hadoop — as well as C++. Kudu’s architecture allows for operation across sites, according to one slide. That makes it comparable to Google’s Spanner and the Spanner-inspired CockroachDB. That could make Kudu a great choice for big companies looking to store their big data around the world.

Is Kudu well adopted, though? No, not yet.

“Looking for beta customers,” a slide said.

More information:

Powered by VBProfiles



RSS-4

Pixel Film Studios Releases TransTunnel for Final Cut Pro X.

FCPX Transition Developer Pixel Film Studios announces a new Final Cut Pro X Transition.

(PRWeb September 23, 2015)

Read the full story at http://www.prweb.com/releases/2015/09/prweb12977288.htm

All articles

Related:


RSS-5

Google says its voice search system is now more accurate, especially in noisy places

If you’ve noticed Google doing a better job of understanding what you say using speech recognition on your smartphone lately, you’re not crazy. Google’s voice search has indeed become more accurate, thanks to advances in artificial intelligence, the tech company announced today.

“Today, we’re happy to announce we built even better neural network acoustic models using Connectionist Temporal Classification (CTC) and sequence discriminative training techniques,” Google Speech Team members Haşim Sak, Andrew Senior, Kanishka Rao, Françoise Beaufays and Johan Schalkwyk wrote in a blog post today. “These models are a special extension of recurrent neural networks (RNNs) that are more accurate, especially in noisy environments, and they are blazingly fast!”

The new models are working in the Google app for iOS and Android, as well as dictation on Android, which works inside of some third-party apps, the team members wrote.

From VentureBeat

Location, location, location — Not using geolocation to reach your mobile customers? Your competitors are. Find out what you’re missing.

Google has reported improvements in voice search not once but twice this year. Clearly the company has been investing in the underlying technology. RNNs are one increasingly popular approach to doing deep learning, a type of artificial intelligence, and Google is widely thought to have a deep bench in deep learning.

But Apple and Microsoft, among others, have also been working to improve their voice recognition capabilities. Meanwhile, Facebook is also doing more in the area, having acquired a speech recognition company, Wit.ai, some months ago.

Speech could become more important as an input to searching the Web in the years to come. Baidu’s Andrew Ng, who is known for his work on the so-called Google Brain, last year predicted that within five years “50 percent of queries will be on speech or images.”

“In addition to requiring much lower computational resources, the new models are more accurate, robust to noise, and faster to respond to voice search queries — so give it a try, and happy (voice) searching!” wrote Sak, Senior, Rao, Beaufays, and Schalkwyk.

Read the full blog post for more detail on how the team managed to get the new performance gains.

More information:

Powered by VBProfiles



RSS-3

Google launches its Keep note-taking app for iOS

Google today launched Google Keep for iOS. You can download the new app now directly from Apple’s App Store.

We’re a bit surprised it took Google this long to debut an iOS app for its note-taking service. Google Keep first launched way back in March 2013 for Android and the Web, meaning the iOS version is showing up 30 months later. Google even brought Google Keep to Android Wear, its smartwatch platform, in June 2014.

Nonetheless, Google says the features Google Keep users have come to expect on Android and the Web are now available to iPhone, iPad, and iPod touch users. That means iOS users can search and filter notes by color and type (images, audio, and text), add labels, set time or location-based reminders, and share notes for basic real-time collaboration.

Here is the full feature list, from the iTunes description:

  • Capture, edit, share, and collaborate on your notes on any device, anywhere.
  • Add notes, lists, photos, and audio to Keep.
  • Organize your notes with labels and colors.
  • Set and forget. Get reminded about a note at the right time or place.
  • Record a voice memo and have it automatically transcribed.
  • Grab the text from an image to help you quickly find that note again through search.

This release isn’t going to convert Evernote or OneNote users, as both have iOS apps with plenty of features. If, however, you’re already using Google Keep on another one of your devices, being able to access your notes on your Apple gadget is a welcome addition. If you’re a Windows Phone user, we wouldn’t hold our breath until Google shows some interest in Windows 10.

While it appears this is a full-featured release, we have asked Google if there is anything missing from the iOS app that is currently available on Android and the Web. We will update you if we learn anything new.

More information:

Powered by VBProfiles



RSS-3

Ubuntu Make Now Lets Users Install the Unity 3D Editor in Ubuntu Linux

Ubuntu Make Now Lets Users Install the Unity 3D Editor in Ubuntu Linux
Didier Roche, the creator of the Ubuntu Make command-line utility that lets users of the Ubuntu Linux operating system install various useful third-party projects, has announced the release of a new maintenance version. Ubuntu Make 15.09 is now …
Read more on Softpedia News

ownCloud Announces Ubuntu-Based Appliance with ownCloud Proxy
Being based on the long-term supported Ubuntu 14.04 (Trusty Tahr) operating system, the ownCloud Appliance comes fully pre-configured and includes the ownCloud Proxy app, which was introduced during the ownCloud Contributor Conference event that …
Read more on Softpedia News


RSS-4