Best practices aren’t enough

Trading Psychology 2.0: From Best Practices to Best Processes

Trading Psychology 2.0: From Best Practices to Best ProcessesI’m currently reading Brett Steenbarger’s “Trading Psychology 2.0: From Best Practices to Best Processes.” I’m a fan of Dr. Steenbarger’s work and bought his new book as soon as it was released.

While this book is targeted at traders and investors, there’s a great deal of knowledge that can be gleaned from it that can be applied to many other aspects of your personal life as well as business.

For example, the premise of the book is that the four main ‘habits’ a trader should focus on to improve their trading are “adaptability, creativity, productivity, and self-management.”   Those four habits are ideal of any individual and any company to focus on as well.   Just like a trader, a business can have the best strategy in the world but if they can’t execute on that strategy and adapt to changing markets in a creative way, the strategy is (or will become) worthless.

I ran across this nugget in one of the first chapters and thought it worth sharing:

…what makes traders good are best practices—sound methods for deploying capital and managing risk. What makes traders great are best processes: detailed routines that turn best practices into consistent habits. Adaptability, creativity, productivity, and self-management: These aren’t just things that the best traders have. They are what best traders do—routinely.

Emphasis mine.

Interesting concept isn’t it?  Best practices aren’t enough….to be consistent and remain in business as a trader, consultant, person or company, you need best practices and best processes.  But the key to long-term success in anything is how you build, change and manage your best practices and best processes.

A best practice today isn’t going to be a best practice next year.  The same is true for processes. Something that works today may not necessarily work next year.   You need both best practices and best processes but you also need to have the wisdom to know when those need to change to adapt to the changing marketplace.

This is where the four key habits come into play.  If you can adapt your strategy you can survive.  If you can think of new ways to approach your market and client base, you can survive.  If you can be both creative and adaptable while doing the right things and managing yourself and/or your business, you’ll not only survive but you should thrive.

Best practices aren’t enough. You’ve got to add best processes into the mix.  Additionally, you (or your business) need to have the smarts and creativity to know when its time to change those processes and practices to better align yourself and your strategy with existing or future market conditions.

Back to the book…while it is targeted at trading, there are a lot of very valuable insights that can be applied to all aspects of your life…I highly recommend it.

The Dichotomy of Data Access and Data Privacy

yin-yangIn order to use data within your business, you must first collect that data. Seems simple enough right?  You capture some data, store it somewhere and the use that data at a later time in your analysis.

What about data privacy concerns? Where are you collecting your data? How are you protecting that data?  Are you collecting/using social network data or other user-generated data from public sources?   If you are using data from ‘users’, do they know their data is being collected, stored and used for something other than the system it was generated in?

These types of questions are the ones that every organization and data scientist should constantly be asking, especially if a single byte of captured and/or analyzed data is generated by a consumer or user of your systems.

In addition to the data that you might capture within your organization (and perhaps from social media, blogs and other user-generated content), there will be data available from data brokers. It may not be next week or next year, but you can bet that all the data that are captured via wearables and other Internet of Things devices will be made available for a price.

Over on Business Value Exchange, Helen Beckett, in a post titled “Watch Out! The Personal Data Market is Coming”, writes:

Citizens and consumers, who generate thousands of bytes of data every day – switching on devices or utilities, making purchases, boarding transport or just walking down the street in CCTV cities – can celebrate. The data they collectively generate is an asset that is being mined to create value and making companies and even industries rich on the back of it. Now the personal data exchange is coming.

Companies will jump at the chance to buy data from these brokers and exchanges and begin using that data in their analysis. Just think about how powerful it would be for an insurance company to have access to your health data via Apple Health or Fitbit or data from a device in your car that reports on speed, location, distance driven, etc.

From a data science and an organizational perspective, having access to data like this is an enormous advantage for any company looking to better understand their clients.  If you can gather data on individual users daily activities, it makes it much easier to market to those users as well as customize your products/services to those users.

From an individual perspective, it is a little frightening to know that every aspect of my driving or my fitness routines (or lack thereof) could find its way into the hands of my insurance company. Likewise, it is disconcerting to know that said data could also make its way into the hands of companies who want to market their services or products to me based on where I’ve driven or how far (or how little) I’ve walked in the last few weeks.

As data scientists and organizations, we want to be able to access and analyze as much data as possible and we want data that is as granular as possible.  With personal data available today (or available in the near future), we have very granular data.

As individuals, we are (or should be) concerned with how companies are using our own data.  We at least want to know how that data might be used and when it is being used.

This is the dichotomy we face today. We want to use as much data as possible but we also worry about data privacy of our own data.  The challenge for any organization or data scientist is to find the right balance between using the right data with the right granularity with necessary privacy issues that consumers need and want.

How is your organization balancing data privacy and data access?

This post is brought to you by HP’s Business Value Exchange.

More isn’t always better

More is always better?More is always better right?

More feedback from clients can help you improve your service.  More money can help you build better products and teams. More data can help you make better decisions.  More resolution can make your photos better.

More is always better isn’t it?

Well. No. More isn’t always better.

Seth Godin recently said that “Too much resolution stops giving you information and becomes merely noise, which actually gets in the way of the accuracy you seek.”

This is very true. Anyone that’s ever worked with data will tell you that more data just means more work. Sure, you may find a great nugget in that additional data, but that extra data doesn’t always equate to more knowledge but it always equates to more work.

To Seth Godin’s point, more ‘resolution’ isn’t always the answer either. I can go buy a $50,000 camera with the highest resolution possible and still make terrible photos. Just because I have the resolution available to me doesn’t mean I have the lenses available to take advantage of that resolution nor does it mean I have the talent to utilize the high resolution.

More isn’t always better.  Adding more data to your already large data set isn’t going to find the answer for you. It might help you find more questions to ask, but it doesn’t guarantee that an answer will be found.

Rather than go spend $50K on the ‘best’ camera, spend $500 on an OK camera and learn the skills and methods  needed to make the most of what you have. When you’ve mastered your ‘art’, then move up to something more expensive with more functions.

Rather than focus on gathering more data, you need to be focused on using the data you have in the most optimal way possible. Make sure you have the tools and skills in place to analyze / use what you have before you go and add ‘more’ to the mix.

Normalcy Bias and You

Normalcy BiasIf you aren’t familiar with the term “normalcy bias”, here’s a quick definition:

Normalcy bias is…the phenomenon of disbelieving one’s situation when faced with grave and imminent danger and/or catastrophe. As in overfocusing on the actual phenomenon instead of taking evasive action, a state of paralysis.

Another way to think about normalcy bias is the often used term in project management circles of ‘analysis paralysis.’ A much simpler way to think about normalcy bias is that it is an assumption that nothing bad will happen in the future because nothing bad has happened in the past.

I hope everyone reading this can see how dangerous normalcy bias can be, especially for people or organizations going through difficult times.  People are smart and can generally see that things aren’t working out for them or their company…but very few people take action to make a change.

I can provide a real-world example from my past to illustrate this point.

An Example

While in grad school for my MSEE, I worked in the telecom industry and did some contracting work at a major telecom player in the mid to late 1990’s. This company was a leader in the telecom space and was growing by leaps and bounds but just about everyone I spoke with at the company was worried about the future of the business.  They didn’t know how the business could continue to grow at the pace they had been growing at and were always amazed that growth continued at a record pace.   I was a dumb kid with little life experience and couldn’t quite understand how the business was growing so rapidly but I just figured there were people way smarter than me making decisions and leading this company so I just shrugged my shoulders and went about my work.

Things were apparently great for this particular company throughout the 1990’s. They were setting records for revenue and growing rapidly. Everyone I spoke with at the company was concerned that the company was going to implode ‘soon’ because they just didn’t understand how the growth could continue.  There was a real fear of a major catastrophe ‘soon’ but nobody seemed to be doing anything about it.  Everyone was focused on an implosion because they didn’t feel like things were going that great but nobody seemed to be taking any steps to ‘fix’ the problems.  I remember speaking with some folks back then about the issues and can clearly remember someone saying “well…nothing bad has happened yet so I doubt it will.”

Everyone that I spoke with was guilty of falling into the normalcy bias trap. I fell into that trap as well.  The normalcy bias trap is an easy one to fall into…its ‘easier’ to expect nothing bad to happen even while being presented with bad news.  People (and entire companies) can (and do) tend to ignore the bad news and expect things to ‘work out.’

By the way…that company I used in the above example WorldCom. They filed the largest bankruptcy ever filed (at the time) in 2002.  There was plenty of reasons for people to be worried about their operations and business model but instead of trying to do something about it, people ignored it.  That said, there are many times that things can’t be done because people at the top don’t want things to change…but that’s a different issue.

Normalcy Bias and You

The above example isn’t an ideal one because there are plenty of extenuating circumstances that could have kept people from doing anything about the impending ‘disaster’.  As it turns out, there were plenty of things wrong at WorldCom but there were people at the top of the company that were actively working to hide any wrongdoing and any issues. That said, there were plenty of people suffering from normalcy bias because they assumed things would be fine in the future because they had always been fine even with all of the issues that existed.

Normalcy bias is a very dangerous thing.  By assuming things will always be fine because they have always been fine, you are putting blinders on to issues and not preparing yourself or your organization for change that is most likely coming.

Normalcy bias can be your downfall and the downfall of your business.  Don’t let yourself fall into the trap of focusing on the outcome to the extent that you paralyze yourself from doing anything. Also, don’t make the assumption that nothing is going to happen because it hasn’t happened yet…there are too many examples of failure of families, companies and societies to allow yourself to assume nothing bad will ever happen to you or your business.

To overcome normalcy bias, identify the issues that might happen and be prepared if they do. Don’t go overboard of course but have a plan of action to address the issues you see, minimize the risk that those issues might cause and then have a plan to deal with the fallout from if the issue(s) are ever realized.

Don’t let normalcy bias destroy your life, career or company.  Identify the risks in your life/business, mimimize or remove those risks and then create a plan for how you will deal with those risks if they become reality.

The most critical skill?

large-iconI’m an avid reader. I tend to read a few books at a time (I read one depending on my ‘mood’ at the time).

The other day, I was scrolling through the various sections in Amazon’s Kindle Unlimited program and somehow ended up in the ‘self-help’ section.   Now, I’m not a fan of self-help books because they tend to try to tell people that they can follow a ‘recipe’ and then they’ll be ‘all better.’  Life doesn’t work this way…but self-help guru’s sure want readers to think that way.

While scrolling through the self-help section, I saw a ton of ‘learn to be wealthy…’, ‘love yourself…’, ‘follow these rules to be X..’ (substitute anything for X) and other ‘standard’ self-help books that, in my opinion, really won’t help many people.

In the middle of all these books, I found one that actually would help just about anyone that read it.   I don’t remember the actual title of the book but it was something like ‘critical thinking – the only skill you’ll ever need.’  If you (or anyone) only reads one self-help book, it should be one on how to think critically and apply the skill to your life.

I’ve written about critical thinking before. I believe its a skill that we all need to continually practice and apply to our lives and its a skill that is lacking these days.  Thinking critically can help anyone in any situation.

Need to get out of debt?  Sit down and think critically about why you are in debt and then come up with a plan to get out of it. Want to make more money?  Sit down and think critically about why you want to make more money and then come up with a plan to do it.  Maybe you won’t become a millionaire but you could get a second job to pay off that debt or send your kids to college.

Maybe you need to reorganize the entire IT group.  Do you go out and buy a book about how to organize an IT group or do you sit down and think critically (and impartially) about how your team needs to be organized to deliver the services that your organization needs?  I know some CIO’s do the former but most successful CIO’s take the latter approach.

Critical thinking is extremely important for a person and for an organization.  If you feel the need to buy a self-help book any time soon, try finding one on the topic of ‘critical thinking.’


Making Theory Meet Practice


Theory-PracticeThis won’t surprise many people (at least I hope it doesn’t)…there is a huge difference between “theory” and “practice”.

I’m an academic AND and practitioner. I have a Doctorate in Information Systems and have worked in aspects of IT / IS for almost 20 years now.  Theory is great at preparing people for doing things in the real world, but many times theory is just that…theory.

For example,  back in 2006, I earned the Project Management Institute’s (PMI) Project Management Professional (PMP) certification. Prior to earning the certification, I had been managing projects for a number of years and was absolutely floored by the PMP study material and the ‘theory’ behind managing projects.  Sure, much of this theory is useful in some manner but much of it isn’t practicable in many projects I worked on over the years.  I didn’t renew my PMP certification when it expired because I didn’t see the value in having those particular letters after my name. Also, don’t get me started on companies that will only consider hiring Project Manager’s with the PMP certification.  The PMP cert is a great example of ‘theory vs practice’….just because you know the theory behind project management doesn’t mean you can actually manage a project.

Another example can be found from my background.  I earned a Master of Science in Electrical Engineering (MSEE) from Oklahoma State University with a specialization in Wireless Telecommunications.   While working on my degree, I learned a lot of theory about wireless telecom and how to design systems.  I also learned a lot of other stuff related to Control Systems, Electrical Engineering, Neural Networks, Stochastics, Signal Processing and other  interesting (and difficult) stuff. I learned a lot of theory about how things work. I learned how to calculate things and design things…in theory.

When I got out in the real-world, I realized the theory was useful but not ideal. I didn’t have any real knowledge about how to actually DO anything useful. At the time, I couldn’t tell you how to add a new tower into a CDMA network or do PN planning for that tower/network. I couldn’t tell you which antenna was best for a scenario. Sure, I knew the difference between an omni antenna and a directional antenna but the real-world use cases of antenna types was unknown to me.

Another example can be found with my doctorate work. When I was looking for a topic for my dissertation I was told by many people to just ‘pick something because you’ll never revisit the work’. That was terrible advice for me…if I was going to spend time working on something, I wanted to get some value from it.   So…I chose to look at combining my interest in the financial markets with my interest in social media and sentiment analysis. This led to my dissertation titled “Analysis of Twitter Messages for Sentiment and Insight for use in Stock Market Decision Making.”

While my dissertation is very academic, I made sure to spend time on real-world application of the theory and developed Trade The Sentiment. I wanted to make sure that theory met practice.

Making sure theory meets practice is a difficult thing to do for some but easy for others. I think there’s probably some study out there that shows that some people are more prone to theoretical pursuits versus hands-on pursuits (and vice versa). That said, to be able to get things ‘just right’, you need to find a way to link up theory and practice.

We always read about those companies and people who are ‘great’ at what they do. There are tons of books on the subject of how to become ‘great’ (e.g., Good to Great, etc) and many of these books tell you to ‘do X and you’ll be great’. It’s never as simple as following a recipe but I can say that the companies and people that I know that are really good at what they do are able to make theory and practice mesh well together.

For example, one of the best project managers I know is a PMP and has been managing projects and programs for many years. She knows PMI’s “body of knowledge” and project management better than anyone I know (except for maybe Glen Alleman) but she also knows how to apply that theory to each project. She knows what things to skip and what things to focus on while managing projects and she knows that each project is different and requires different management styles.   Her projects are generally on-time and on/under-budget and she rarely throws PMP ‘theory’ around while successfully managing these projects.

Merging theory and practice can be difficult and often takes considerable experience to be able to do successfully.   What tips do you have to make theory meet practice?