Skip to content
Reading settings

Reading settings

Export or import reading records
Keep your reading records

Completion, bookmarks, reading positions and preferences belong to this browser origin. They do not automatically move to another address.

Export at the original address, then choose that backup at the new address. Everything stays in your browser; nothing is uploaded or deleted at the original address.

The file is checked before you confirm. Completion and bookmarks are combined; existing positions, last-read state and preferences win conflicts.

G34 · Guided learning

Building a Universe Without Survivorship Bias

Change only a synthetic membership list to see how historical eligibility, exits, security identity, and missing data affect the question a backtest answers.

Not marked completeMaterials ↓

A ten-year price table has no missing rows. It looks unusually clean, but its security list comes from today. Companies that later delisted, merged, or disappeared were never downloaded. Can it answer what an investor could have selected ten years ago?

Their absence now did not give an earlier investor a way to avoid them. Restricting research to present survivors may remove difficult outcomes before calculating any signal. Change only the membership list first, then identify the records a historical universe needs.

What you will be able to do

  • Distinguish today's list, a historical eligible universe, and actual strategy holdings.
  • Identify different treatments needed for exits, halts, renaming, and corporate actions.
  • Save dated membership and missing-data records, limiting conclusions when evidence is unavailable.

Preserve a complete starting record

This independent synthetic membership exercise belongs to the C4 error laboratory. It is not C4-S1's trading ledger and changes none of that case's threshold, next-open, or fee rules. Securities, amounts, and outcomes here are teaching inputs rather than actual market history.

At the period's start, A, B, and C are eligible. Invest $100 in one unit of each to isolate membership, for $300 total. There are no dividends, fees, taxes, external flows, or rebalancing. Ending equity is $110 for A and $90 for B. C exits the market, with final recovery explicitly supplied as zero.

C's zero is a given terminal outcome, not a replacement for an unavailable quote. Ending value is $110 plus $90 plus zero, or $200. Relative to $300, the return is approximately negative 33.33%.

Introduce just one error: use the ending survivor list, deleting C and its entire history. Start again with $100 in each of A and B. Initial value is $200 and ending value still $200, showing 0%. No rule has become better at investing. The evaluation subject has changed to the two securities identified afterward as survivors.

The difference is not trading skill. Later survival status changed eligibility and capital allocation at the beginning. We deliberately avoid additional errors such as omitted costs or duplicate dividends so the membership effect remains identifiable.

For equal starting capital of $300, the mistaken survivor list would put $150 in each remaining security. Ending value would again total $300, still a 0% return. The problem is not merely different dollar amounts in the first comparison: C's loss disappeared and its capital was redistributed to survivors. Return percentages normalize scale without repairing that selection.

This illustrates survivorship bias. Its size and direction depend on omissions and the strategy. Removing any exited security does not necessarily improve a return; an acquired company may have performed well. Preserve objects according to the research question and historical eligibility, rather than later outcomes.

An eligible universe is not a buy list

A universe is the set eligible for research or selection at a particular time. Holdings are the subset a strategy actually owns. Eligibility does not require a purchase, and leaving the universe cannot erase gains or losses already incurred by an existing position.

“Select from the index's constituents then” needs membership at each relevant date. Today's constituents can define today's question. Filling them into a ten-year historical table does not establish research conducted on constituents available at those earlier dates.

Announcements and effective dates also differ. S&P's March 6, 2026, announcement described changes effective before trading opened on March 13 or March 23. [1] Knowing a change was announced does not make membership effective immediately for every purpose.

A strategy trading announcements could be studied, but it differs from selecting only effective constituents. State which date controls eligibility, then check information availability. Do not switch dates after discovering which produces better performance.

A changed ticker need not mean a different security

A company can change name or ticker and also undergo mergers, spin-offs, or share-class changes. Linking prices by today's ticker alone can split one security into several records or join different rights into one invented history.

Use relatively stable security identifiers and dated mappings for names, tickers, and classes. CRSP's official stock-database description lists permanent identifiers, corporate actions, and delisting data as distinct items. [2] They serve separate purposes; subscribing to a database would not automatically make every research decision correct.

Company and security identity are not interchangeable either. One company may have several share classes or depositary receipts. A common-stock history cannot casually continue into another claim. For a merger, establish whether old holders receive cash, shares, or both, and when those rights become usable.

In a membership record, assign synthetic A a stable ID such as A01. If its ticker changes, retain the ID and record each ticker's effective period. Without confirming continuity of the right, block the join instead of allowing similar names to decide the mapping.

Exiting does not always mean zero

Zero recovery completes C's exercise inputs. Actual delisting can involve bankruptcy, privatization, acquisition, or continued trading elsewhere, with different subsequent rights. Neither zero, the last price, nor initial capital is a universal terminal-value policy.

Investigate final distributions, conversions, and dates. Check whether the data provider's return already includes the exit treatment. Adding the recovery again to an already-inclusive return duplicates value. Using only the last transaction can instead omit subsequent outcomes. The field name alone may not resolve either question.

A trading halt can prevent a planned transaction. No new trade does not establish stable economic value or a sale available at the old close. Record valuation policy, tradability, and missing returns separately. If an old price is temporarily displayed, preserve its limitation rather than advertise low volatility from a stale series.

Treat entry symmetrically. A later-listed security may have no tradable prelisting history. Filling its first price backward creates an artificial stable past and can improperly satisfy a minimum-history filter. Qualification depends on what existed at the decision date.

Ask which kind of value is missing

A missing quote can reflect transmission failure, a market holiday, a halt, prelisting, or an exit. Similar blank cells have different meanings. Assigning zero returns universally makes unknown or untradable observations appear known and stable.

Deleting every row with missing data can also change the ranked universe. Missingness associated with business trouble may select on later outcomes again. Even random transmission failures require disclosure of effective sample changes and comparison conditions. A cleaner file is not necessarily a more faithful representation of the original question.

Appropriate responses can include obtaining evidence, blocking the study, pausing new orders under registered rules, or narrowing the claim. Choose for the task and strategy, not afterward to give one losing security a favorable exception.

An uncertain terminal value particularly needs an explicit limit: “C's subsequent rights are unverified, so the complete-account return cannot be established.” Hypothetical recoveries can support separate scenarios. They cannot become an actual backtest result by selecting a convenient endpoint.

Correct members still need consistent return definitions

Membership is one gate. Splits, dividend timing, exit returns, and share exchanges also affect total return. Signal series and holding ledgers have different jobs. An adjusted price cannot simply become a real fill price, and a dividend-inclusive return cannot receive the same dividend again outside it.

Combining prices, membership, and actions from different sources requires matching identifiers, dates, currencies, and time zones. Downloading a revised history today does not establish the version available then. Put that limit beside the conclusion instead of burying a generic data-warning sentence in an attachment.

Reconcile one known event first: units before, rights or cash afterward, timing, and the combined return. This check can locate problems without replacing full-universe coverage review. It is more controllable than running every security first and guessing which data treatment caused an unexpected curve.

Can fixed-ETF research still proceed?

C2-A specifies SPY and cash, observing 2007 through 2024 with prescribed warmup, a month-end signal based on ten valid month-end total-return observations, next-normal-trading-day opening execution, and defined cost scenarios. It examines rules on a fixed asset, not historical cross-sectional stock selection.

Missing market-wide membership data does not require changing that task into today's surviving winners. Check the chosen asset's prices, actions, and account, limiting the result to that asset and interval. SPY itself is a surviving asset selected retrospectively, so disclose that selection limit too.

The fixed ETF cannot establish performance for liquidated, merged, or unselected funds. Holding it directly also does not establish reconstruction of all its underlying historical constituents. Research selecting across stocks or funds needs the relevant membership, identity, and exit evidence.

This chapter obtains no complete real membership packet and runs no actual C2 backtest. Completing its synthetic exercise shows understanding of a sample-selection error, not that a strategy has eliminated survivorship bias in real data.

Find the error and recompute

Why does the survivor-only 0% fail to show that C was avoidable at the start? Suppose C's last quoted price is $20 and later records are missing. Can $20 automatically become final recovery? Identify the evidence needed before reading the answers.

C was deleted using later survival, rather than an earlier rule acting on known information. Initial funding also changed from $300 to $200. For the terminal value, investigate exit cause, subsequent rights, tradability, and distribution timing. The last trade need not equal final recovery, and the supplied zero in the exercise cannot fill a real record's gap.

Change the membership problem

A separate synthetic universe starts with four objects at $100 each, with no flows, fees, or rebalancing. Ending equity values are $120, $80, $40, and zero. The last exits with zero final recovery explicitly established; the first three survive. Calculate full-universe return and the return after retrospectively removing the last object and restarting the others at $100 each.

Full starting value is $400 and ending value $240, giving negative 40%. The survivor subset starts at $300 and also ends at $240, giving negative 20%. The twenty-percentage-point gap concerns an outcome-selected subset; its return cannot replace the original complete question.

Now suppose the $40 object only changed ticker and was mistakenly deleted. Repair identity through the stable ID and event mapping first. The exercise supplies survival and ending equity, so a ticker change cannot remove it. If those facts are unknown in real materials, obtain evidence instead of borrowing this synthetic security's result.

Save historical membership and exit records

Specify the universe, qualification time, membership effectiveness and availability, identity mappings, minimum history, listing and exit events, missing-data classifications, terminal values, and action treatment. Record source, version, and verification status for each. Missing evidence does not mean no effect.

Preserve correct and erroneous results differing only in current-membership backfilling. Record how starting capital, weights, and the evaluated objects change. Other problems, such as omitted costs, belong in separate entries so a combined repair does not obscure the cause of the difference.

Can you explain eligibility at a past date? Can an exited holding's rights still be followed to cash or shares? If either lacks support, narrow the study or mark its conclusion unverified instead of discarding the hard case.

Find the disappeared objects before calculating signals

Define historical eligibility first. Current lists, historical membership, and actual holdings answer different questions. Announcements, effectiveness, listings, and exits have clocks, while a changed name still needs identity evidence.

Classify missingness and subsequent rights before choosing valuation, trading, or sample policies. Limited materials support limited questions; a fixed-ETF exercise does not replace market-wide evidence. Retaining failures, exits, and unknowns prevents history from choosing a favorable ending for the strategy in advance.

References

  1. S&P Global: March 6, 2026, index-constituent changes. Original example of announcement and separate effective dates, not a recommendation to trade constituents.
  2. CRSP: US Stock Databases. Permanent company/security identifiers, active and inactive securities, exits, and actions. Public descriptions only; no database, license, or complete history was obtained.

Sources checked October 30, 2026. AI-assisted draft; independent AI full-text and bilingual review is complete. Human financial review and target-reader testing have not been conducted and are not scheduled in this phase. C4 membership experiments are separate original synthetic inputs.

Article Materials

C4 · 6 files
Browse all materials →
Sources, Version, and Review

Last updated: 2026-10-30

SHA256 6116a0a03ba76b0ba72b5c02332a175c2856e799b5a7bbf3a15924cfa54fe34a

Cases: C4

This page uses the corresponding manuscript. AI review, bilingual checks, and unresolved issues are tracked separately. Human financial review and target-reader testing have not been conducted.

Report an issue with this article
Handbook contents

Records stay in this browser.

On this page
Search handbook