How Does Trade Execution Work

Foreword

This post discusses what happens from the time when you send an order, to the time when your order is either rejected, cancelled or executed.

As usual, a reminder that I am not a financial professional by training — I am a software engineer by training, and by trade. The following is based on my personal understanding, which is gained through self-study and working in finance for a few years.

If you find anything that you feel is incorrect, please feel free to leave a comment, and discuss your thoughts.

Definitions

InstrumentAny tradable thing, generally interchangeable with “security”.
LotUsually means 100 shares of a particular stock.
Some stocks, like BRK-A are so expensive that a “lot” of that stock is just 1.
Odd lotAny number of shares of a stock less than a lot.

For example, 50 shares of AAPL is an odd lot.
OrderA firm commitment to trade an instrument at a certain price, either buying or selling.
An order can be cancelled, but until it is, the issuer of the order must stand ready to fulfill their promise to buy or sell.
FlowA stream of orders, sometimes also used for a stream of IoIs.
BookThe totality of all orders that an entity knows about, for a particular instrument.

For example, NASDAQ may have a book for GOOG that looks like:
Bids: 100shares@$100, 200shares@$90
Asks: 100shares@$101, 300shares@$110
Top of Book (ToB)The best bid and ask of a book.

In the example above, the ToB would be:
Best bid: 100shares@$100
Best ask: 100shares@$101
TradeAlso called an “execution”. A trade happens when 2 orders, one buying and one selling, agree upon a price and quantity for an instrument. This results in money going from the buyer to the seller, and the instrument going from the seller to the buyer.
Order matchingThe act of finding 2 orders to produce a trade.

In our example above, no 2 orders can match, because the best bid is below the best asking price.
However, if a new order comes in to buy 50shares@101, then this order can be matched with our best ask, to produce a trade
50shares@$101

After this trade, our ToB would be:
Best bid: 100shares@$100
Best ask: 50shares@$101
Market dataA (maybe real time, maybe delayed) stream of information about the trades and the state of the books of an exchange.
Venue

AKA trading venue
A venue refers to either an exchange or alternative trading system, where traders can send their orders to get routed to another venue, or to be executed.
Exchange

AKA lit exchange

AKA lit venue
A trading venue that publishes market data publicly, e.g: NASDAQ, NYSE, Amex, etc.
Dark pool

AKA Alternative Trading System (ATS)
A trading venue that does not publish market data publicly, e.g: Sigma X, CrossFinder, MS SORT, etc.

They are not always an “exchange” — an “exchange” implies a book and order matching — dark pools may not have a book and may not match orders, they may trade against incoming orders using their own portfolio.
Protected quotes

AKA National Best Bid and Offer (NBBO)
This is the ToB of all lit exchanges put together.

For example, if NASDAQ has these quotes for MSFT:
Bids: 100@$50, 200@$49
Asks: 300@$52, 400@$53

and NYSE has these quotes for MSFT:
Bids: 500@$49, 600@$48
Asks: 700@$51, 800@$52

Then the NBBO is:
Best bid: 100@$50
Best ask: 700@$51

Note that odd lots are generally ignored for the purpose of computing the NBBO. i.e: Odd lots are generally not protected, even if they are the best bid or ask.
NMSNational Market System, created by Investment Act of 1933. NMS is a rule which says that any order that is executed, must execute at a price within NBBO (inclusive).  There are some exceptions, but these typically don’t apply to retail orders.
Regular trading hours (RTH)Between 9.30am and 4pm Eastern time on a trading day. This is the period of time when the market is said to be “open”, and starts with the opening auction at 9.30am, and ends shortly after the closing auction around 4pm.
After hoursAny time other than RTH.
BrokerAn entity that takes an order and figures out where to send it so that it can get matched and executed.
DealerAn entity that takes an order, and trades against it (i.e: the dealer is the counterparty of the order creator).
Broker/Dealer (BD)Most brokers are also dealers, and vice versa. Because of this, brokers and dealers are collectively known as brokers/dealers or BDs for short.
Market maker (MM)An entity that is mandated by SEC/FINRA rules to always keep a bid and ask up for the instrument that it is market making for, on a particular exchange.

Note that a market maker for FB on NASDAQ may not be a market maker for FB on NYSE, etc.
Wholesale market maker (WMM)Really a BD, a WMM is an entity that accepts orders from retail brokers, and either
a) Figures out where to route that order so that it can be matched and executed, OR
b) Trades against the order using their own portfolio, OR
c) Holds the order in their own book for matching against future orders.
InformedAn adjective to describe either an entity, order or flow.

An informed entity, order or flow is someone or something that has an edge. In general, this edge involves some non-trivial understanding of the system and/or the macro and/or micro environment(s).

Usually, “informed” is applied with a very short time horizon. For example, an order is informed if within a few milliseconds to seconds of the order being sent, the price of the instrument moves upwards.

Also called “toxic”. (1)
Uninformed (1)An adjective to describe either an entity, order or flow.

An entity, order or flow that is uninformed is, well, not informed.

Typically synonymous to “retail orders/traders”, it is also generally applicable to more sophisticated entities, such as hedge funds, if they are not trying to optimize for very short term (milliseconds to seconds) time horizons.

Basics

There are 10+ lit exchanges in the US for equities, several more for options, futures, etc. In general, to be called an “exchange” requires being subject to stringent regulatory rules set by the SEC, a Federal government agency. Exchanges, in turn, are part of FINRA, which is a self-regulatory body consisting of exchanges and large brokerages. Together, SEC and FINRA set the rules that govern all equities trading in the USA.

A trade can happen as long as all the rules that SEC/FINRA impose are met. The rules which generally apply are:

  • NMS is enforced during RTH and so all trades must occur within NBBO (inclusive).
    • There are exceptions to this rule, such as for large orders (block trades), corrective trades (busts, corrects), etc.
  • During RTH, prices cannot move by too much within a 5-minute period. The bands are defined using an algorithm the SEC dictated.
    • Orders which are outside the band must be modified to comply or rejected by the broker.
    • Even if trades are within the bands, if volatility is too high as judged by various parties (SEC, FINRA, exchanges, etc.), trading in a particular stock can be halted.
  • During RTH, circuit breakers are in effect — if the price of S&P500 declines by too much, the entire market is halted for defined periods of time, up to an including an early end of the trading day.

Order handling

Only licensed BDs are allowed to connect directly to exchanges. As part of maintaining that license, BDs agree to a shared responsibility to “maintain orderly markets”. What this means, is that all rules that the SEC/FINRA impose, must be adhered to by all BDs. If an order which is in breach of the rules is received by a BD, they are responsible for either modifying the order so that it is compliant, or rejecting the order. Any BD who forwards (routes) a non-compliant order to another BD or exchange, may find themselves being disciplined by the SEC/FINRA.

Because there are so many rules to pay attention to just to validate an order, most BDs don’t actually connect to the exchanges directly. Instead, they have contracts with other BDs, such that the original BD is allowed to send some types of non-compliant orders to the second BD, and the second BD assumes the responsibility of validating and possibly rejecting those orders. In effect, our original BD has its own BD. The original BD, the introducing BD, will forward any orders they receive to the second BD, the executing BD. The executing BD will then figure out what to do with the order, also known as “working the order”.

Retail orders

In general, retail BDs, such as Robinhood, E-Trade, Charles Schwab, etc., typically do not know how to work an order. They are, for the most part, glorified UI+app+accounting.  When you send in an order to a retail BD, they will route the order to a specialized BD, also called a WMM, not to be confused with a regular MM — though most WMM’s are also regular MMs, in some capacity (i.e: some instrument+exchange pairs). There are 3 major WMMs in the US – Citadel Securities, Two Sigma Securities and Virtu Financial. There are also a bunch of minor WMMs in the US, but they have very little flow compared to the big 3.

So, when JoeRetail sends an order to RetailBroker, RetailBroker will send the order to WholesaleMarketMaker, who then has 4 choices:

  1. Trade against the order, using their own portfolio.
    • There are a bunch of rules they have to comply with, enforced by the SEC/FINRA, to ensure that the WMM gives JoeRetail a reasonable deal.
  2. Forward the order to a dark pool or lit exchange or another BD.
  3. Hold the order on its books.
  4. Cross the order against another order already on its books.
    • Must comply with all the rules mentioned above relating to order execution.

From worst to best for JoeRetail:

  • In general, the first option is usually a bad deal for JoeRetail — because the WMM is informed, while JoeRetail is almost definitely uninformed — there is an information asymmetry and generally speaking, the WMM will come out of the deal better off.
  • Routing to a dark pool is generally bad for the order as well, for similar reasons.
  • Being held on the WMM’s books is sort of bad — it implies the order is not immediately executable (it does not cross the far price, which is the best bid for a sell order, or the best ask for a buy order), so the WMM is putting it on ice until something changes and the WMM can decide again later.
  • Routing to another BD just repeats the process.
  • Immediately crossing against an order already on the WMM books is OK, but not the best thing.
  • Routing to an exchange is probably the best thing that can happen to the order.

National best guess for bid and offer

Why is it not the best thing for the order to trade against other client orders on the WMM’s books?  Surely those orders must also be uninformed?
Yes, those orders are uninformed, but the problem is that NBBO is weird.

Remember that WMM has to execute within NBBO.  But NBBO is not the best bid/offer of all exchanges (it’s just called that).  It is just the best protected and lit bid/offer.

For example, if the absolute 2 best offers on all lit exchanges are:
Sell 99 GOOG @ $100
Sell 100 GOOG @ $101

The first order (@ $100) is not the NBBO — because it is an odd lot. So, even though the WMM knows about that order (lit exchange books are public), and you only want to buy 99 GOOG, the WMM does not have to execute your trade at $100, it can execute your buy order at $101. However, if your order to buy 99 GOOG was routed to the exchange, it’ll definitely be executed at $100.

More interestingly, and this is something that most people don’t appreciate — the WMM may not be allowed to fill your buy order @ $100, even if it wants to.  For example, if NASDAQ has both those sell orders, and NYSE has this buy order:
Buy 100 GOOG @ $100.10

Then the NBBO is $100.10 to $101.  Which means filling your order at $100 will be below the $100.10 best bid, which is against the NMS rule.  This situation is known as a crossed market.  It happens, but rarely and usually not for very long.

Another problem with NBBO is that it is not well defined.  Remember that all the exchanges are located at different geographic locations.  So, depending on where you are, market data (i.e: the book) of different exchanges will reach you at different times.

So even if you use the exact same algorithm to build the NBBO, someone in Kentucky and someone in Connecticut can genuinely see different NBBOs, simply because the exchanges’ market data reach them at different times.

Because of all these issues, BDs cannot just use any NBBO algorithm. The algorithm they use must be blessed by the SEC/FINRA.  OR, they can just use the SIP. The SIP is a company that publishes various market data for all participants.  Because it is sanctioned by the SEC/FINRA, if you use the NBBO published by the SIP, you’ll generally be fine — SEC/FINRA generally won’t give you grief about that.

But that introduces 3 other problems:

  1. The SIP itself is located at some location, which means it’s seeing market data of a certain latency.
  2. The SIP itself has very little incentives to get better (since it’s effectively a mandated monopoly), so it’s software is very slow compared to the rest of the market.  It’s common for the SIP to send out data that’s 1-100ms behind what the rest of the market actually see.
  3. Depending on where you are in relation to the SIP source, you may get data that’s even slower because now the data source is 2 hops away.

Finally, the last bad thing about NBBO is that it doesn’t account for hidden orders.  We already know the NBBO ignores odd lots.  But it also is ignorant of hidden orders.  Venues (lit or otherwise) typically allow orders to be hidden from the public and not published in market data.  These are typically orders that are big, because if someone wants to sell 1,000,000 shares of GOOG in a single order, anyone seeing that order will freak out and dump GOOG (OMG! They know something we don’t!). To avoid market panic, these large orders are typically hidden — sometimes totally hidden, sometimes they may show up as only 100 shares on the books of the exchanges. That’s why even if you see NBBO as $100 – $101, and you send an order to an exchange to buy at $100.50, you may actually hit a hidden order, and get executed.

Of course, because these orders are hidden, they don’t show up in NBBO, which means WMMs don’t have to honor that $100.50, even if they can reasonably guess that the order is there (there are ways to forecast/predict this, I won’t go into that).

To conclude, by not going to an exchange, you potentially lose out on potential liquidity that can fill your order at a better price.  WMMs can, perfectly legally (and sometimes forced to by SEC rules), fill your order against their own portfolio, then go out and buy/sell at a better price on the lit exchange to make an instant profit.

Footnotes

  1. Yes, yes, yes, the terms sound disparaging. They are not meant to be — these are official (and technical) terms. If you don’t like it, talk to the textbooks.

Investing vs Speculating 3

Foreword

I want to start by noting that I am not a financial professional by training — I am a software engineer by training, and by trade. The following is based on my personal understanding, via some formal classes, but mostly self-taught.

If you find anything that you feel is incorrect, please feel free to leave a comment, and discuss your thoughts.

This post is a continuation of Investing vs Speculating and Investing vs Speculating 2. If you have not read those posts yet, you probably should before continuing here. A separate related post, Zero Sum Game, finally rounds up why understanding investing vs speculating is important.

Starting to invest

Whenever someone asks me for newbie investment advice, I almost always tell them the same things:

  1. Read “The Intelligent Investor: The Definitive Book on Value Investing“.
    • It is outdated, but contains a lot of still useful information.
  2. Then chase down all the bits that seem wrong/outdated, and in doing that research, hopefully you’ll understand the topics better, and more importantly, understand yourself better.
  3. Finally, you need to decide what kind of person you are.
    • Are you an investor? If so, which kind?
    • Are you a speculator?  If so, which strategy appeals to you more?

Only then, can any sort of useful advice be given.

This is also why whenever you open a brokerage account, the broker always asks you whether you are “hedging, seeking income, seeking growth, etc.”.

Essentially, they are trying to understand which of the above modes apply to you best, and when. And in so doing, they can better tailor their recommendations and advice for you.

I are investor

Not everyone is suited to be an investor.

Some people simply cannot stomach the paper losses that investing sometimes entails. It takes a special kind of crazy, masochistic instinct for someone to look at your portfolio which is down 50%, and think, “OMG, I MUST BUY MORE!

If you are unable to stomach such losses, and you are also terrible at speculating, then I suggest buying illiquid assets, or simply don’t look at the stock markets at all, after you do your research and have bought.

I won’t lie — doing this is dangerous! You may miss when fundamentals really do change and your model needs updating.

But it’s better than constantly panicking at the slightest dip. If nothing else, you’ll sleep better.

I value value investing

If you are value investing, you typically put in a lot of work per company, which means you likely won’t have time to invest in too many companies. As such, diversification is rare in value investing (remember Buffett’s quote about being “too diversified”).

On the other hand, if you are macro/passive investing, you mostly only consider macroeconomic issues and/or your personal temperament and needs, both of which apply to large swaths (or even all) of companies. As such, diversification helps to dilute the idiosyncratic risks of investing in individual companies.

These are not black/white extremes, it is a spectrum.  The more you are willing to dive into the details of companies, the less you should diversify — the more you are sure of a company, the more you should concentrate your bet.  The less you are willing to dive into individual companies, the more you should diversify to avoid idiosyncratic risks that you’ve overlooked.

I R speculator

If you are speculating, then there is always the element of “what if you’re wrong”.  Combined with the lack of a fallback in terms of earnings, a wrong bet can be disastrous.

As such, successful speculators generally employ very robust risk models, where they:

  1. Limit exposure to each bet (i.e: position sizing)
  2. Limit increasing exposure as the bet works (i.e: take profits if the bet works out well)
  3. Limit downside risk (i.e: cut losses if the bet is souring)

Yes, it seems like everything says “don’t bet”, that’s not quite true.  It’s a matter of degree, and depending on your strategy (momentum, mean reversion, event driven or arbitrage), one or another of the 3 factors dominate.

For example, if you are betting on momentum, you typically use small bets on many names.  When momentum bets pay off, they tend to pay off big, so even small bets will make a meaningful difference to your entire portfolio.  At the same time, you cast a wide net, because you want to ensure that you catch at least a few of the momentum runs.

In momentum bets, limiting downside risk is generally easy — at some point, your momentum model will tell you that momentum is in the opposite direction, which is when you close out the position and/or go short.

But taking profits on the upside is generally hard — typical momentum models will suggest you buy more as the stock rises, because it has more momentum!  So (b) is where your risk model should concentrate, for momentum models.

For mean reversion models, the opposite is true — as the stock goes up, your model will naturally tell you to start shorting, while as the stock tanks more, your model will tell you to buy more, potentially catching a falling knife.  So for mean reversion, your risk model should concentrate on (c).

Risk models should be crafted carefully with an understanding of the primary model.

Stay true

Whatever you choose to do, be honest with yourself, and be very clear:

  1. What you are doing
  2. How you will make a profit
  3. When you should reevaluate and/or cut losses

If you invest blindly without understanding what you are investing in, you are not even speculating — you are purely gambling.

If you speculate blindly without understanding your exit criteria, you are also just gambling.

Gambling is fine, I have nothing against gambling — but understand that when you gamble, you are paying a fee to be entertained.  So gamble if you want, just don’t expect a (positive) return.

Investing vs Speculating 2

Foreword

I want to start by noting that I am not a financial professional by training — I am a software engineer by training, and by trade. The following is based on my personal understanding, via some formal classes, but mostly self-taught.

If you find anything that you feel is incorrect, please feel free to leave a comment, and discuss your thoughts.

This post is a continuation of Investing vs Speculating, and if you have not read that yet, you probably should before continuing here. There is also a final wrap up to this series, Investing vs Speculation 3. Finally, a separate related post Zero Sum Game rounds up why understanding investing vs speculating is important.

Question

What do you do if the market tanks 50% tomorrow?
The answer, as always, is, “it depends”.

To formulate a proper answer, we first need to discuss why people buy financial assets, because the reason why they buy financial assets is key to understanding their mindset and motives.

Why buy assets

The two main reasons to buy financial assets are: investing and speculating.
I want to note that I have nothing against investing nor speculating.  Both are, in my opinion, critical for the proper functioning of markets.  Therefore, read the following with the understanding that I’m not disparaging either, but just noting their characteristics.

Investing

There are 3 main types of investing: value investing, macro investing and passive investing.

Value investing, where

  1. You look deeply at the fundamentals of the company’s business,
  2. and try to formulate some sort of projection/model for the path the business will take.
  3. Based on your understanding of the risks and characteristics of the business, you then decide what kind of returns you would accept.
  4. Based on the returns you would accept, you can then estimate a price which you would be willing to pay.
  5. Finally, you buy stock in the company if it is trading for lower than what you’d be willing to pay.  Otherwise, you move on to the next company to evaluate.

For example,
Let’s say I believe StableCo will generate around $100 per year for the next 10 years. StableCo is in a stable industry, so the business is unlikely to grow much, but is also unlikely to decline significantly. Therefore, there’s probably little variance to that $100 earnings that I should expect.

For such a company, I decide that I want at least 7% return per year. That translates to a total market cap of around $1429. That is, I would be willing to buy the whole of StableCo for $1429. If StableCo had 100 shares outstanding, then I would be willing to pay $14.29 per share.

Note: There are various definitions of “value investing”, some of which are really more a form of speculation using quantitative methods. Here, I am referring to the definition of “value investing” as popularized by Benjamin Graham, and that which is espoused by his book “The Intelligent Investor”.

Macro investing, where

  1. You are focused more on the macroeconomics side of things.
  2. You form models/projections on how different economies and/or sectors of an economy will perform in the near future,
  3. and you allocate resources to those which you believe will perform relatively better.

For example,
I analyzed the political, economical and financial policies of two countries, Wakanda and Rohan. Based on my understanding of these policies, and the geographic realities of each country, I’ve decided that:

  • Wakanda would be able to commercialize their natural resources. That stream of revenue would allow the government to dramatically improve the lives of its citizens, achieving an annual growth of 10% of its economy.
  • Rohan, however, has an economy that’s effectively stuck in the medieval age. Its infrastructure is essentially a series of dirt tracks for horse drawn buggies, and there is little chance its economy will grow by more than 2-3% a year.

Because of these, I decide to allocate my portfolio entirely to Wakanda. Within Wakanda, I further subdivide my portfolio, so that a majority of the portfolio is in industries related to the extraction and export of natural resources.

Passive investing, where

  1. You assume, a priori, that the economy generally trends upwards,
  2. and so if you buy a bunch of different companies, you’ll be able to diversify away idiosyncratic risk.
  3. This then allows you to just make whatever returns the economy provides.

Note that there is significant overlap between passive investing and macro investing. In both, you generally decide on a portfolio allocation at the macro level — domestic economy vs international economies, diversification across sectors, etc.

The main difference, is that in passive investing, you generally don’t form an opinion of how each will perform against the other. Instead, you base your portfolio allocation based on your risk tolerances and other needs.

Answer for investors

As mentioned in Investing vs Speculating, in all cases, your goal is to earn the returns of the businesses that the companies you bought are engaging in.

When you are purely investing, you should buy whenever you feel that the future earnings of the companies you are buying will provide sufficient return for the current prices you are paying today.  As such, the future prices of the companies don’t really matter — what matters is the current prices you are paying now vs the future earnings of the companies.

If you are purely investing, and the stock price of the company you’ve bought tanks by 50%, then you should:

  1. Determine if the fundamental characteristics of the business of the company has changed.
  2. If not (i.e: your prior model is still accurate), you should either:
    1. Ignore the stock price — after all, you are not looking to earn your return from the stock price, OR
    2. Determine if the new stock price is low enough that you can risk putting more money into the company.
      • Remember that putting more money down in the same asset means increasing your risk to that asset, so you’ll need a larger margin of error to compensate for that risk.
  3. If yes (i.e: the fundamentals of the company has changed), you should rebuild your model/projection for the company, then:
    1. Sell the stock if the new projection suggests that at the new stock price, you would not be making the return you are looking for, OR
    2. Ignore the stock price, if in the new model, the new stock price justifies the current investment in that company, OR,
    3. Buy more stock, if in the new model, the new stock price provides enough margin of error to compensate for the additional risk.

Speculating

There are 4 main types of speculation: momentum, mean reversion, event driven and correlation.

For simplicity, I’ll just assume we are buying.  Shorting is just the inverse, and should be fairly easy to reason out.

Momentum is where you expect whatever has gone up in the near past, will continue going up in the near future.

For example,
It has been shown that most stocks show some form of momentum — if a stock has gone up in the recent past, it tends to go up more in the near future.

A simple momentum strategy would be to just buy any stock whose price is above its 50day moving average, and hold them for 1 week. (1)

Mean reversion is where you expect whatever has gone down in the near past, will go up in the near future.

For example,
Over long periods of time, the VIX index tends to revert to a range of around 10-20.

A simple mean reversion strategy here would be to just short the VIX index whenever it is above 80, until it goes below 30. (2)

Event driven is where you expect some event in the near future will cause the asset to go up.

For example,
LargeBuyerCo has announced that it is looking to acquire some companies to expand on its online advertising platform.

You did some research and narrow down the list of candidates to 3 companies which are publicly traded. You buy the stocks of each 3 company, and wait for LargeBuyerCo to announce their targets. (1)

Correlation is where you expect two related time series to exhibit similar performance over time.

For example,
The countries of Gondor and Arnor are close to each other geographically, and share many characteristics such as political climate, monetary and fiscal policies, etc. The citizens of both countries can also move freely between the both countries, and so, each country is the largest trading partner of the other.

Based on these factors, you expect that economies of Gondor and Arnor to be closely linked. You therefore build 2 baskets of stocks — one holding the largest 10 companies in Gondor, and the other building the largest 10 companies of Arnor.

You expect that these 2 baskets of stocks will move very similarly to each other over time, and so whenever one basket is underperforming, you buy that basket and short the other. You do so until the gap between the performance closes, which is when you close your position. (1)

Answer for speculators

As mentioned in Investing vs Speculating, in all cases, your goal is to earn a profit by someone paying more for the asset when you sell it to them.

There are 2 main ways for the value of the asset to go up — either the fundamentals become better (i.e: the asset is fundamentally worth more), or the price multiple becomes higher (i.e: the asset is priced richer).

Note that while we are looking at fundamentals in the first case, we aren’t “investing”!  We are betting that the fundamentals will improve, and we are looking to profit from the increase in the price of the asset when the fundamentals improve, not from the earnings of the businesses because of the same fundamental improvement.

Another name for the second case is the “Greater Fool theory”.  Essentially, you buy an asset without an understanding of whether the fundamentals justify the price, but with the belief that someone else will pay a richer price in the near future.

Examples of where fundamentals may change:

  • New product line (e.g: new iPad model)
  • Changes in characteristics of the industry (e.g: lithium mining after EVs become popular)
  • Inflation (e.g: devaluation of currency)
  • Reduced regulations (e.g: more opportunities to squeeze out profits)
  • Cyclical industry at trough (e.g: industry wide recent underinvestment due to prior overinvestment)

Examples of where price multiples may change:

  • Price insensitive buyer (e.g: buybacks, index inclusion)
  • Reduction in risk free rate (i.e: reduced discounting of future earnings)
  • General market euphoria/fear (e.g: when a bubble is forming, all stocks tend to do well)

So, what should you do, if the stock of the company you purely speculated in tanks 50%?

  1. If you are betting on momentum, then clearly you were wrong, and you should close the position, and maybe even go short instead.
  2. If you are betting on mean reversion, then either you were wrong, or you were early.
    Trying to figure out which is generally hard, and requires looking deeper at your model and figuring out what went wrong.
    1. If you believe your model to still be correct, you either hold on the position, or buy more.
    2. If you believe your model was wrong, then you close out the position, and rework your model.
  3. If you are betting on an event,
    1. If the drop was after the event, then clearly you were wrong and you should close out the position.
    2. If the event has not occurred, you need to decide if your model of whether the event will still occur, and what that event entails for the stock price is still accurate. 
      1. If so, you should probably hold, and/or buy more.
      2. Otherwise, you should close the position.
  4. If you are trying to trade correlations, then the other leg(s) of your trade should have mitigated the bulk of the 50% drawdown.
    1. If not, your model may be wrong, and you should think carefully to see if perhaps you missed something, or if situations have changed, so that the model no longer works.

Wrapping up

Obviously, there is a lot of overlap between all the above.  While for the most part, whether an action is more investing or more speculating is generally obvious, there is also a lot of grey area.

Realistically, very few people purely invest, and very few people purely speculate — it’s mostly a matter of degree.

In some cases, people deceive themselves — they started out trying to speculate, but when the trade went wrong, cognitive dissonance convinces them that they were actually investing, and so they hold on to a bad trade far longer than they should.

In the end, they end up hurting only themselves.

In yet other cases, people start out speculating, but the success of the trade triggers their greed and they convince themselves they had an investment thesis all along.  They too, then, hold on for far too long.

If enough people do this to the same asset, a bubble forms, and for a while (which can be a very long time), everyone can seem to be really smart. Famous bubbles in the past have lasted years… before reality rudely intrudes and everything comes crashing down.

Sometimes flip flopping between investing and speculating is bad, but sometimes it is good.  If you do flip flop, then you should be sure to be very clear to yourself why you are flip flopping.

If you changed a speculative bet into an investment, you should be very clear and very sure about the model you are using, and be sure that the projected returns is at or above your desired return.  You should evaluate everything from scratch, as if it was a new investment.

Otherwise, you stand a fairly good chance of blinding yourself if the stock price deteriorates, by constantly convincing yourself that “you are investing and price does not really matter”.

Footnotes

  1. This is an example, not an actual, viable strategy.
  2. Shorting is inherently dangerous, and shorting a volatile index like the VIX is doubly so. The short VIX strategy is an example, not an actual, viable strategy.

Investing vs Speculating

Foreword

I want to start by noting that I am not a financial professional by training — I am a software engineer by training, and by trade. The following is based on my personal understanding, via some formal classes, but mostly self-taught.

If you find anything that you feel is incorrect, please feel free to leave a comment, and discuss your thoughts.

This post is the first of 3, and is meant to lay the groundwork for the following posts: Investing vs Speculating 2 and Investing vs Speculating 3. A separate related post Zero Sum Game rounds up why understanding investing vs speculating is important.

Definitions

I personally prefer the traditional/classical definition of investing vs speculating, which is roughly:

Investing – The act of putting money to use, by purchasing some productive asset, and then profiting from the products of that asset. For example, by buying a business with a factory, and then producing Widgets (the product) which can then be sold by the business for a profit.

Speculating – The act of buying and selling assets with the intention of profiting from the appreciation in prices of the assets. For example, by buying the same business above, and then selling the business (not Widget!) again to someone else at a higher price.

For some, these definitions may seem foreign — for anyone who started managing money around the late 90’s, their personal definition of “investing” may be closer to my definition of “speculating”, or at least, a mix of both. And they probably define “speculating” as something along the lines of “investing with high risk”.

That’s fine! You are certainly allowed to define words as you see fit, within reason. But I feel that while we are on the topic of finance, we should probably use definitions from finance. This avoids ambiguity, since different people reasonably can have slightly different preferences on definitions.

Hopefully in the following post and future posts, this differentiation and the reason for it, will become clearer.

PredictableCo

Let’s say everyone in the world has a crystal ball, and can see for a company, PredictableCo, how much profits it’ll make before PredictableCo does out of business sometime in the future. How PredictableCo ends doesn’t matter, but let’s just say it goes bankrupt (i.e: stock is worth $0) (1).

Now, the crystal ball is mission specific, and only allows you to see the future profits of PredictableCo, and nothing else.  Specifically, you do not know future interest rates, just current and past interest rates.

So, given this, how much should PredictableCo be worth now?

The answer should be trivial — PredictableCo’s future profits are essentially “risk free” (because crystal balls are like boy scouts — they never lie).  So, take all pending future earnings, discount to present using the relevant “expected future interest rates”, and that’s your price for PredictableCo.

However “expected future interest rates” are, themselves, speculative — nobody knows what they’ll be (crystal balls for future interest rates is a developing feature). Right now, there’s just a bunch of assumptions and predictions for them.  So, if person A assumes future interest rates will be higher, they may be willing to pay less for PredictableCo than person B who assumes future interest rates to be lower.

That said, we can make this statement, which I believe will be true:

The net amount of gains and losses, from all investors of PredictableCo, across all time, based only on PredictableCo, will be exactly equal in dollar value to the sum of all earnings of PredictableCo.

As a simple example, let’s say PredictableCo generates $100 a year for 10 years and then goes bankrupt. The exact way this $100 is returned to the owner is mostly irrelevant for this discussion, but let’s say this is paid out yearly as dividends.
Total earnings = $1,000.

Let’s say I create PredictableCo from nothing in year 1.
Year 1:
I make $100 from the business.

And then I sell PredictableCo to B for $500 in year 2.
Year 2:
I get $500 from B.
B pays $500 to me, makes $100 from the business.
Net for me: (100)+(500) = $600.

In year 4, B sells PredictableCo to C for $200.
Year 3:
B makes $100 from the business.

Year 4:
B gets $200 from C.
C pays $200 to B, makes $100 from the business.
Net for B: (-500+100)+(100)+(200) = -$100

C then holds PredictableCo until year 10 when it ceases to exist.
Years 5-10:
C makes $100 each, total $600 from the business.
Net for C: (-200+100)+600 = $500

Net for everyone = $600(me) – $100(B) + $500(C) = $1,000 = total earnings of PredictableCo

To put it simply, the net amount of absolute dollars that everyone makes from a single company, simply from trading/investing/speculating on that company, is just the sum of all earnings from that company (2).

Investing vs Speculating

And if you think about it, it really doesn’t matter if you know or do not know what the company’s future earnings will be.  The statement still holds.  The only thing that changes, if you cannot predict future earnings, is that the price people are willing to trade that company for is more volatile, because different people naturally have different expectations, same as how they have different expectations for interest rates in our crystal ball model.

And therein lies my mental model of investing vs speculating. When I’m investing, I’m making a prediction of the future earnings, with the expectation that I’ll get those future earnings one way or another (dividends, liquidation, stock price increase, etc.). The exact method that the earnings is received doesn’t really matter, and importantly, some of these methods (such as stock price increases) may incorporate speculative profits/losses from others.

When I’m speculating, I’m making a prediction of other people’s predictions.  When I buy for speculation, I’m predicting that other people predict the company will be worth more, regardless of whether it’s because they are investors (and thus predict more earnings than the current price indicates) or speculators (and thus predict that yet other people predict an even higher price).

If you are investing, you need to figure out the fundamentals of that company.  You need to know what the earnings are, whether they are sustainable, whether the company is sustainable, etc.  And then you need to make a guess on the future interest rates, and finally discount everything to present.  If you can buy the company for a better price than your result, you should (3).  Otherwise, you shouldn’t.

So think about your own “investment process”, as well as the process of people you listen to for investment advice.  Are you/they doing these?  Are you/they investing or speculating?

I have nothing against speculation — I do it myself all the time, and I believe it is an important component of a fully functioning market.

But there is a dramatically different mindset when you are investing vs when you are speculating.

Don’t conflate the two for an instant, or you may end up confusing or lying to yourself, to detrimental results.

Footnotes

  1. In the event that PredictableCo gets bought out instead of going bankrupt, you can model it this way:
    • 1s before the buyout, PredictableCo makes a profit of exactly the amount of the buyout, by selling all its assets, and paying off all its debts.
    • 1s after that, PredictableCo, because it no longer has assets nor debts, goes bankrupt at $0.
  2. We are ignoring fraud, taxes, etc.  You can model fraud, taxes, etc. as basically just a reduction in earnings.
  3. Note that in this case, “earnings” is individualized and should include opportunity costs.  If you don’t, then the statement should be reworded to:
    You should buy the companies that are the most undervalued.