Tag Archives: big data

Big Data to Tomcat Behind Nginx

In a Web application I created, I need to upload some data to a Java Servlet for further processing. I wish JavaScript could be more powerful so that I can process everything in the front end, but I could not find a good JavaScript library for the job.

Everything works well until some big changes got in – it stopped working sometimes and the pattern is not quite consistent. Initially I thought it was because of long time processing at the server side.

Posted in Applications & Tools | Also tagged , , | 2 Responses

Big Data or Big Junk?

Two weeks I got a problem with my blog site. Somehow I could not post to announce the GA of open source ViJava API for vSphere 5.1 there. After searching and researching, I found out that the wp_commentmeta table was filled with extra amount of data that exceeded the per database limit of 100MB imposed by my service provider. While I was enjoying Thanksgiving holiday, some spammers and their robots worked diligently posting thousands of spam comments on my site.

Posted in Big Data | Also tagged | 13 Responses

Big Data: How Big is Big?

I came across a video on Youtube over the past weekend: Big Ideas: How Big is Big Data. Although coming with several mentions of EMC, it’s very well prepared and demonstrated with white-boarding, therefore worthwhile to share here.

Some of the key points made from the video include:

  • The growth is accelerating. By 2020, there will be 50x more data than today.
Posted in Big Data | Tagged | 2 Responses

Will Enterprise Hardware Be Hot Again?

BusinessWeek recently published an article “In Silicon Valley, Hardware is Hot Again.” Almost all big names started to sell hardware now, Microsoft, Google, and Apple of course. Apple’s stellar success in iPhone and iPad disrupted the conventional wisdom that software is higher in margin compared to hardware. Also, Apple’s hardware and software combined devices posts a real risk for Microsoft and Google. To be exact, the hardware in the article title should really be software bundled hardware. That is why Google and Microsoft had to get into hardware business competing directly against Apple.

Posted in Cloud Computing | Also tagged , , | Leave a comment

GPU for Big Data Processing

While talking about the data processing, we naturally take CPU for granted. However, latest GPU (Graphics Processing Unit, also know as Visual Processing Unit, or VPU) comes with hundreds of cores and calculates much faster than CPU. The question is how practical it is to use GPUs in processing big data.

Posted in Big Data | Also tagged , , | 5 Responses

Hadoop For Enterprises: Event By Churchill Club

This past week was a busy one for Hadoop community with two Hadoop events in Silicon Valley. The first one was “what role will hadoop play in the enterprise” by Churchill Club which attracted about 300 attendees in a Palo Alto hotel. The second one was the much bigger conference Hadoop Summit in San Jose Convention Center. I will write a separate article on the second event soon.

Posted in Big Data | Also tagged , , | 1 Response

    My company has created products like vSearch ("Super vCenter"), vijavaNG APIs, EAM APIs, ICE tool. We also help clients with virtualization and cloud computing on customized development, training. Should you, or someone you know, need these products and services, please feel free to contact me: steve __AT__ doublecloud.org.

    Me: Steve Jin, VMware vExpert who authored the VMware VI and vSphere SDK by Prentice Hall, and created the de factor open source vSphere Java API while working at VMware engineering. Companies like Cisco, EMC, NetApp, HP, Dell, VMware, are among the users of the API and other tools I developed for their products, internal IT orchestration, and test automation.