VMware Online Forum 2013 – Virtualization meets the Virtual World

This post is brought to you by VMware and their Online Forum 2013 Event

One of the best parts about working in the technology field is having the ability to attend conferences where you can meet new people and learn about new technologies and products.

Over the past few years, the budget for conferences has been reduced and even slashed completely at many organizations.  Part of this budgetary cutback has been due to economic issues but some of it can be attributed to the fact that attending a conference takes time away from actually delivering services/products to the organization.

I can remember spending weeks at a time on the road attending conferences. I’d spend my days learning and meeting/greeting on the conference floor and in meeting rooms and evenings catching up on work. It was brutal for sure…but for the most part, I enjoyed it.

Budgetary cuts at vendors have also forced a pullback. While many vendors still attend conferences, a good number have been looking for other methods of reaching clients and potential clients.  Some vendors, like VMware have used both in-person conferences as well as ‘virtual’ conferences to reach their audience.

I’ve attended a few of these online events in the past and they do a good job providing learning and networking opportunities without you having to leave your office.  Sure…you’ve still got to put time into the even to get the most from it, but you aren’t traveling and living out of hotels  and airports.

There’s a good event coming up for anyone interested in learning more about Virtualization. VMware is putting on an online event in April. Its free to attend which makes it even better for those of us in budget conscious environments.

The description of the event:

Online VMware Forum 2013 is a free online event where you will learn how to radically simplify your IT infrastructure across the entire data center to the virtual workspace. Hear VMware and industry experts discuss new products and services that extend the benefits of virtualization, combine virtualization with best-in-class automation and management, and empower end users with workplace mobility and freedom.

Join us online and learn how you can more efficiently and reliably deliver IT services that are accessible from any device—anytime, anywhere.

You can signup for the event here.

Topics covered in the forum will be:

  • Extend the benefits of virtualization across the software-defined data center– including compute, security, storage, availability, and networking—establishing the most efficient, reliable and agile architecture for cloud computing
  • Combine virtualization with best-in-class automation and management capabilities to optimize capacity, improve utilization, and drive cost savings
  • Empower end users with workplace mobility and freedom to choose their devices, while maintaining IT control

I’ve signed up and will be attending…how about you?

This post is brought to you by VMware and their Online Forum 2013 Event

Correlations – Twitter Sentiment, AAII Sentiment Survey and the S&P 500 Index

This is a cross-post from Trade The Sentiment

I just finished presenting a paper titled Bulls, Bears…and Birds? Studying the Correlation between Twitter Sentiment and the S&P 500 Index at the Business Intelligence Congress 3 in Orlando Florida.  Once the paper is formally published, I’ll share a link to the PDF.  Oh….and the paper won best Research paper at the conference 🙂

A quote from the abstract of the paper:

This research had three main goals: 1.) To determine if data analytics can be used to automate sentiment analysis from Twitter messages; 2.) To determine whether the outcome of the analytical engine is comparable to existing survey methods and finally; 3.) To determine if there is any actionable knowledge contained within Twitter sentiment that can be used to make investing decisions.

Each of the above goals was accomplished. Twitter data can be collected and analyzed using standard sentiment analysis methods. Additionally, using Bayesian Classification techniques combined with a manually generated training data set, resulted in an outcome which is correlated to existing sentiment survey methods (e.g., the AAII Sentiment Survey). Lastly, using standard statistical methods, there is very little statistical correlation between the Twitter Sentiment found within this study’s sentiment analysis methods and the closing price of S&P 500 Index.

Using my training data set and the Python Natural Language Toolkit’s Naive Bayesian Classification methods and performing statistical correlations using the Pearson Correlation method, there is virtually no correlation between the overall market Daily Twitter sentiment and the Daily closing price of the SPX.

Using Pearson Correlation methods is a standard method of determining whether a linear relationship exists between between two sets of data. The correlation values range from +1 to -1 with a value of +1 meaning that there is a perfect linear correlation between the two data sets and a value of -1 meaning that there is a perfect inverse linear relationship between the two data sets. A value of 0 means there is no correlation between the two data sets.  Note: looking for a linear relationship between sentiment and SPX Close price might be naive here, but its the simplest relationship to begin with.

A Scatterplot of Daily Twitter Sentiment Data and Daily SPX Close prices shows virtually no linear relationship exists.

Bears-BullsBirds.pptx-Microsoft-PowerPoint-non-commercial-use_2012-12-15_11-29-00

Correlation Details of the Daily Bear/Bull Ration and SPX Close:

Bulls, Bears and Birds - Final-name.docx - Microsoft Word non-commercial use_2012-12-15_11-09-57

Additionally, there is virtually no correlation between the AAII Sentiment Survey and the SPX Weekly Closing Price nor is there any correlation between the Weekly Twitter Sentiment and the SPX Weekly Closing price.

Bulls, Bears and Birds - Final-name.docx - Microsoft Word non-commercial use_2012-12-15_11-12-51

There is, however, a fairly strong correlation between Twitter Sentiment on a Weekly Basis and the Weekly Sentiment Survey released by the American Association of Individual Investors (AAII) with a Pearson Correlation value of 0.583 being found.

Correlation Details of the AAII Weekly Sentiment Survey and Weekly Twitter Bear/Bull Ratio:

Bulls, Bears and Birds - Final-name.docx - Microsoft Word non-commercial use_2012-12-15_11-13-11

The conclusion?

Using my training dataset and my implementation of the Naive Bayesian classifier, there is no significant correlation between Twitter Sentiment and SPX Close Price on a Daily or Weekly Basis.  That said, there is a High Correlation between Weekly Twitter Sentiment and the AAII Sentiment Weekly Survey.

Does this lack of correlation mean that Twitter Sentiment (or AAII Sentiment) is useless?

I don’t think so.  In fact, I believe it is very important data.

I’ve written about the use of Sentiment Extremes as a buy/sell signal in the past and I see some real value in these signals. There a number of academic and industry articles describing the use of sentiment and sentiment extremes as contrarian signals. In fact, the AAII has even published an article that discusses the use of sentiment as a contrarian signal.

I’ve been focusing most of my efforts on identifying sentiment extremes and using those values as inputs into investing strategies.  These entry signals appear to be providing exceptional returns with little drawdown when using proper risk management methods.

Additionally, these entry signals from extremes seem to be a better entry method than just taking a random entry as described in my post that compares a Bearish Extreme signal compared to entries taken with a random signal. In that article, it appears that additional returns found using Bearish Extremes from Twitter as an entry signal when compared to entering on a random entry signal.

In fact, using the overall sentiment from Twitter and using extreme levels as an entry signal has delivered pretty good returns over the past year…better than I even initially expect.

How good are the results?  Check back in a few days for a report. 🙂

This is a cross-post from Trade The Sentiment