Skip to content

[experiment] fully order independent type checking - #65064

Draft
Jake Bailey (jakebailey) wants to merge 148 commits into
microsoft:mainfrom
jakebailey:checker-db
Draft

Jake Bailey (jakebailey) wants to merge 148 commits into
microsoft:mainfrom
jakebailey:checker-db

Conversation

@jakebailey

@jakebailey Jake Bailey (jakebailey) commented Oct 30, 2026 •

Copy link
Copy Markdown
Member

There's too much here to explain, but at a high level, this is a massive change which aims to make the checker entirely order independent, that is, it doesn't matter when you call the checker, which nodes you walk first, if you do or do not pull something, check some other file, helicopter into the wrong part of a cycle, etc, the behavior, diagnostics, everything, will be the same.

Looking at individual commits is my suggested way to look inside, not the entire diff, which will surely crash your browser.

This is all AI driven, so it's a bit hard to unbox (I plan to break this apart since some stuff can be done early), but some interesting tidbits (handwritten by me!)


There's a new checkOrder test option, which makes certain tests variant on interesting orderings, like "what if we visit every single node before checking" or "what if we reverse the order of the files" or even "what if we use PRNG to randomly walk nodes and then check". This up front found on the order of 500 failing tests we already had that were secretly order dependent. These were all fuzzed out and kept.

There are a significant number of new tests which all show various ordering bugs never before discovered.

The first chunk of the PR are fixing places where code peeked at caches that "happened to be filled" instead of calling the actual function to pull on them.

Then, all of the ID-using code gets removed. At the end everything now has an ID independent ordering based on content, flags, the works. This caught a bunch of places where we were not caching things and ending up with types that were by all rights identical but had different IDs and then were unstable.

The big and scary change is the introduction of a new state management type dubbed "memo". Every single piece of checker state was moved into memos on a sidecar object on the checker (maybe for future sharing??). This memo system keeps track of the current computation, what depends on what else, eliminating basically all flags/bools that track "computed" or "resolved"-ness. This tracking also records side effects, including diagnostics, "referenced" marks, deferred checks, emit helper checks. The result is that if you query via the API and that calculates some error, those same errors will appear later if the checker runs.

With those data structures in place, now all of the cycles can be handled. Once a cycle is discovered, the checker starts logging what it's doing, and throws all of that info away assuming it's been poisoned.

All of the different recursion stacks get pulled into a single memo stack, which is a cool simplification too.

Variance is now a fixpoint algorithm, proceeding in rounds until stability. In practice, it doesn't iterate much.

Instantiation limits also stop being global numbers (since of course, that is order dependent side effect stuff). Instead, things get limited by the amount of work that's been done, and if you then pull on caches related to work, it tallies that work up to error consistently when needed. (I don't think this is fully done yet, though, since there are depth limits that are really hard to get right. Still thinking about that.)

In some cases, cycles still can't be fixed up, and so they're made consistent by doing what we've done previously for these cases, which is to pick a canonical place to restart to at least get it consistent.


Unfortunately, this all has a cost; the end of the PR tries to claw back perf, but at the end of the day, if we do more work tracking, we spend more CPU and memory tracking. It's still an open question whether this can be cheapened any more. But, my hope is that this idea is minimal enough that we could then optimize TS as a whole assuming this order-independence, e.g. work stealing, checker recycling, shared state, maybe even using LRU caches, or dumping data to disk.

But, it could also well be that this is slop and impossible to manage. But I don't want to sit on it anymore and want to see some real world effects.

Also, this is really meant to be rebased, so expect this all to be nasty nasty force pushes all the time as this gets tweaked. Unfortunately right now that's like 125+ commits, so that sucks.

However, I think that this will fix countless issues on the tracker. I have no idea how to evaluate all 5k issues to see if this PR fixes them. But it's gotta be a lot.

@typescript-automation typescript-automation Bot added Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug labels Oct 30, 2026
@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) test it

@typescript-automation

typescript-automation Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top400 ✅ Started
user test this ✅ Started 👀 Results
run dt ✅ Started 👀 Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), the results of running the DT tests are ready.

There were interesting changes:

Branch only errors: d3-selection

Package: d3-selection

Branch error:

Project scope: tsconfig.json

Error: types/d3-selection/d3-selection-tests.ts:1502:9
TypeScript@local compile error TS2769:
No overload matches this call.
The last overload gave the following error.
Argument of type '(enter: Selection<EnterElement, number, HTMLElement, unknown>) => TransitionLike<HTMLParagraphElement, number>' is not assignable to parameter of type 'string | ((elem: Selection<EnterElement, number, HTMLElement, unknown>) => Selection<BaseType, number, HTMLElement, unknown> | TransitionLike<...>)'.
Type '(enter: Selection<EnterElement, number, HTMLElement, unknown>) => TransitionLike<HTMLParagraphElement, number>' is not assignable to type '(elem: Selection<EnterElement, number, HTMLElement, unknown>) => Selection<BaseType, number, HTMLElement, unknown> | TransitionLike<...>'.
Type 'TransitionLike<HTMLParagraphElement, number>' is not assignable to type 'Selection<BaseType, number, HTMLElement, unknown> | TransitionLike<HTMLElement, number>'.
Type 'TransitionLike<HTMLParagraphElement, number>' is not assignable to type 'TransitionLike<HTMLElement, number>'.
The types returned by 'selection().selectAll(...)' are incompatible between these types.
Type 'Selection<null, undefined, HTMLParagraphElement, number>' is not assignable to type 'Selection<null, undefined, HTMLElement, number>'.
Property 'align' is missing in type 'HTMLElement' but required in type 'HTMLParagraphElement'.
    at combineErrorsAndWarnings (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:200:28)
    at runTests (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:192:20)
Branch only errors: absinthe__socket

Package: absinthe__socket

Branch error:

Project scope: tsconfig.json

Error: types/absinthe__socket/absinthe__socket-tests.ts:29:47
TypeScript@local compile error TS2345:
Argument of type 'Notifier<{ userId: number; }, {}>' is not assignable to parameter of type 'Notifier<{}, {}>'.
Types of property 'activeObservers' are incompatible.
Type 'readonly Observer<{ userId: number; }, {}>[]' is not assignable to type 'readonly Observer<{}, {}>[]'.
Type 'Observer<{ userId: number; }, {}>' is not assignable to type 'Observer<{}, {}>'.
Types of property 'onStart' are incompatible.
Type '((notifier: Notifier<{ userId: number; }, {}>) => any) | undefined' is not assignable to type '((notifier: Notifier<{}, {}>) => any) | undefined'.
Type '(notifier: Notifier<{ userId: number; }, {}>) => any' is not assignable to type '(notifier: Notifier<{}, {}>) => any'.
Types of parameters 'notifier' and 'notifier' are incompatible.
Type 'Notifier<{}, {}>' is not assignable to type 'Notifier<{ userId: number; }, {}>'.
Types of property 'activeObservers' are incompatible.
Type 'readonly Observer<{}, {}>[]' is not assignable to type 'readonly Observer<{ userId: number; }, {}>[]'.
Type 'Observer<{}, {}>' is not assignable to type 'Observer<{ userId: number; }, {}>'.
Property 'userId' is missing in type '{}' but required in type '{ userId: number; }'.
    at combineErrorsAndWarnings (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:200:28)
    at runTests (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:192:20)
Branch only errors: react-relay

Package: react-relay

Branch error:

Project scope: tsconfig.json

Error: types/react-relay/test/relay-hooks-tests.tsx:987:13
TypeScript@local compile error TS2344:
Type '{ mainPanelA?: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params> | undefined; mainPanelB?: EntryPoint<...> | undefined; }' does not satisfy the constraint 'Record<string, EntryPoint<any, any> | undefined>'.
Property 'mainPanelA' is incompatible with index signature.
Type 'EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>' is not assignable to type 'InternalEntryPointRepresentation<any, Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Types of property 'root' are incompatible.
Type 'JSResourceReference<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>' is not assignable to type 'JSResourceReference<EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>'.
Type 'EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'ComponentClass<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of property 'getDerivedStateFromProps' are incompatible.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any> | undefined' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any> | undefined'.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of parameters 'nextProps' and 'nextProps' are incompatible.
Type 'Readonly<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>' is not assignable to type 'Readonly<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>'.
Types of property 'extraProps' are incompatible.
Type '{} | null' is not assignable to type '{}'.
Type 'null' is not assignable to type '{}'.

types/react-relay/test/relay-hooks-tests.tsx:1023:13
TypeScript@local compile error TS2322:
Type '(params: { route: string; }) => { entryPoints: { mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: ...; }; mainPanelB?: undefined; } | ...; queries: ...; extraProps: ...; }' is not assignable to type '(entryPointParams: { route: string; }) => PreloadProps<{ route: string; }, {}, Record<string, EntryPoint<any, any> | undefined>, { foo: "bar"; }>'.
Type '{ entryPoints: { mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: { slug: string; }; }; mainPanelB?: undefined; } | ...; queries: {}; extraProps: ...; }' is not assignable to type 'PreloadProps<{ route: string; }, {}, Record<string, EntryPoint<any, any> | undefined>, { foo: "bar"; }>'.
Types of property 'entryPoints' are incompatible.
Type '{ mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: ...; }; mainPanelB?: undefined; } | ...' is not assignable to type 'ThinNestedEntryPointParamsObject<Record<string, EntryPoint<any, any> | undefined>> | undefined'.
Type '{ mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: { slug: string; }; }; mainPanelB?: undefined; }' is not assignable to type 'ThinNestedEntryPointParamsObject<Record<string, EntryPoint<any, any> | undefined>>'.
Property 'mainPanelA' is incompatible with index signature.
Type '{ entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: { slug: string; }; }' is not assignable to type 'ThinNestedEntryPointParams<EntryPoint<any, any> | undefined>'.
The types of 'entryPoint.root' are incompatible between these types.
Type 'JSResourceReference<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>' is not assignable to type 'JSResourceReference<EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>'.
Type 'EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'ComponentClass<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of property 'getDerivedStateFromProps' are incompatible.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any> | undefined' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any> | undefined'.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of parameters 'nextProps' and 'nextProps' are incompatible.
Type 'Readonly<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>' is not assignable to type 'Readonly<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>'.
Types of property 'extraProps' are incompatible.
Type '{} | null' is not assignable to type '{}'.
Type 'null' is not assignable to type '{}'.

types/react-relay/test/relay-hooks-tests.tsx:1054:15
TypeScript@local compile error TS2322:
Type 'Readonly<{ dispose: DisposeFn; entryPoints: { [x: string]: Readonly<...>; }; extraProps: {} | null; getComponent: () => any; isDisposed: boolean; queries: { [x: string]: PreloadedQuery<OperationType, Record<...>>; }; rootModuleID: string; }>' is not assignable to type 'PreloadedEntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>> | undefined'.
Type 'Readonly<{ dispose: DisposeFn; entryPoints: { [x: string]: Readonly<...>; }; extraProps: {} | null; getComponent: () => any; isDisposed: boolean; queries: { [x: string]: PreloadedQuery<OperationType, Record<...>>; }; rootModuleID: string; }>' is not assignable to type 'Readonly<{ dispose: DisposeFn; entryPoints: {}; extraProps: {}; getComponent: () => FunctionComponent<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>; isDisposed: boolean; queries: ...; rootModuleID: string; }>'.
Types of property 'extraProps' are incompatible.
Type '{} | null' is not assignable to type '{}'.
Type 'null' is not assignable to type '{}'.
    at combineErrorsAndWarnings (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:200:28)
    at runTests (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:192:20)

Full output in the log.

@typescript-automation

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey) Here are the results of running the user tests with tsc comparing baseline and pr:

Something interesting changed - please have a look.

Details

effect

packages/tools/ai-docgen/tsconfig.json

puppeteer

packages/puppeteer-core/tsconfig.json

uglify-js

/mnt/vss/work/1/s/ts_downloads//m/uglify-js/tsconfig.json

  • [NEW] error TS2339: Property 'last_ref' does not exist on type 'never'.
    • /mnt/vss/work/1/s/ts_downloads//m/uglify-js/node_modules/uglify-js/lib/compress.js(2544,35)
  • [MISSING] error TS2322: Type 'false' is not assignable to type 'never'.
    • /mnt/vss/work/1/s/ts_downloads//m/uglify-js/node_modules/uglify-js/lib/compress.js(2544,25)

webpack

tsconfig.json

  • [NEW] error TS2345: Argument of type '[unknown]' is not assignable to parameter of type '[] | [boldQuantity?: boolean | undefined] | [direction?: "child" | "parent" | "sibling" | undefined] | [oversize?: boolean | undefined]'.
  • [NEW] error TS2345: Argument of type 'string | number | boolean | Type' is not assignable to parameter of type 'Type'.

tsconfig.types.json

  • [NEW] error TS2345: Argument of type '[unknown]' is not assignable to parameter of type '[] | [boldQuantity?: boolean | undefined] | [direction?: "child" | "parent" | "sibling" | undefined] | [oversize?: boolean | undefined]'.

tsconfig.types.test.json

@typescript-automation

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=20
Symbols 88,466 88,464 -2 (- 0.00%) ~ ~ p=0.000 n=20
Types 79,607 79,570 -37 (- 0.05%) ~ ~ p=0.000 n=20
Memory Used 103,896k (± 0.02%) 111,077k (± 0.04%) 🔻+7,181k (+ 6.91%) 110,925k 111,227k p=0.000 n=20
Memory Allocs 1,262,232 (± 0.01%) 1,382,888 (± 0.01%) 🔻+120,657 (+ 9.56%) 1,382,595 1,383,138 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.023s (± 2.38%) 0.024s (± 2.35%) ~ 0.022s 0.025s p=0.273 n=20
Bind Time 0.008s (± 4.19%) 0.009s (± 6.30%) ~ 0.007s 0.011s p=0.503 n=20
Check Time 0.214s (± 2.44%) 0.238s (± 0.84%) 🔻+0.023s (+10.82%) 0.232s 0.248s p=0.000 n=20
Emit Time 0.142s (± 1.09%) 0.149s (± 0.98%) 🔻+0.007s (+ 5.16%) 0.141s 0.154s p=0.000 n=20
Total Time 0.391s (± 1.34%) 0.422s (± 0.73%) 🔻+0.031s (+ 8.05%) 0.412s 0.437s p=0.000 n=20
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=20
Symbols 586,461 (± 0.01%) 582,012 (± 0.03%) -4,449 (- 0.76%) 581,488 582,966 p=0.000 n=20
Types 241,684 (± 0.00%) 244,833 (± 0.04%) +3,149 (+ 1.30%) 244,649 245,409 p=0.000 n=20
Memory Used 518,997k (± 0.03%) 799,196k (± 0.04%) 🔻+280,200k (+53.99%) 798,221k 801,135k p=0.000 n=20
Memory Allocs 7,793,838 (± 0.11%) 14,777,317 (± 0.08%) 🔻+6,983,478 (+89.60%) 14,743,392 14,830,518 p=0.000 n=20
Config Time 0.009s 0.009s ~ ~ ~ p=1.000 n=20
Parse Time 0.126s (± 4.43%) 0.124s (± 2.06%) ~ 0.116s 0.136s p=0.473 n=20
Bind Time 0.042s (± 9.91%) 0.045s (±11.57%) ~ 0.036s 0.067s p=0.533 n=20
Check Time 0s 0s ~ ~ ~ p=1.000 n=20
Emit Time 0.827s (± 0.92%) 1.358s (± 1.06%) 🔻+0.531s (+64.19%) 1.297s 1.406s p=0.000 n=20
Total Time 1.015s (± 1.00%) 1.547s (± 0.75%) 🔻+0.532s (+52.46%) 1.499s 1.587s p=0.000 n=20
arktype - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 685,920 737,025 🔻+51,105 (+ 7.45%) ~ ~ p=0.000 n=20
Types 939,467 954,543 +15,076 (+ 1.60%) ~ ~ p=0.000 n=20
Memory Used 495,298k (± 0.01%) 568,199k (± 0.01%) 🔻+72,901k (+14.72%) 567,987k 568,454k p=0.000 n=20
Memory Allocs 12,061,856 (± 0.01%) 15,942,771 (± 0.01%) 🔻+3,880,915 (+32.18%) 15,938,341 15,948,882 p=0.000 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.041s (± 4.12%) 0.042s (± 2.99%) ~ 0.037s 0.047s p=0.793 n=20
Bind Time 0.014s (±10.49%) 0.013s (± 8.24%) ~ 0.011s 0.019s p=0.616 n=20
Check Time 0.883s (± 0.99%) 1.199s (± 0.78%) 🔻+0.316s (+35.81%) 1.158s 1.246s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.966s (± 0.86%) 1.283s (± 0.66%) 🔻+0.317s (+32.79%) 1.253s 1.328s p=0.000 n=20
class-transformer - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 45,376 45,319 -57 (- 0.13%) ~ ~ p=0.000 n=20
Types 7,573 7,219 🟩-354 (- 4.67%) ~ ~ p=0.000 n=20
Memory Used 27,890k (± 0.03%) 30,925k (± 0.02%) 🔻+3,035k (+10.88%) 30,899k 30,943k p=0.000 n=20
Memory Allocs 248,137 (± 0.04%) 267,547 (± 0.05%) 🔻+19,409 (+ 7.82%) 267,126 268,373 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.011s (± 4.90%) 0.011s (± 4.44%) ~ 0.009s 0.013s p=0.870 n=20
Bind Time 0.003s (± 4.63%) 0.003s (± 6.23%) ~ 0.002s 0.004s p=0.381 n=20
Check Time 0.008s (± 5.14%) 0.010s (± 3.52%) 🔻+0.002s (+20.50%) 0.008s 0.011s p=0.000 n=20
Emit Time 0.008s (± 5.95%) 0.010s (± 4.57%) 🔻+0.001s (+17.79%) 0.008s 0.012s p=0.000 n=20
Total Time 0.031s (± 1.77%) 0.035s (± 1.61%) 🔻+0.003s (+ 9.86%) 0.032s 0.036s p=0.000 n=20
effect - native
Errors 12 20 🔻+8 (+66.67%) ~ ~ p=0.000 n=20
Symbols 1,235,115 1,234,949 -166 (- 0.01%) ~ ~ p=0.000 n=20
Types 894,113 890,634 -3,479 (- 0.39%) ~ ~ p=0.000 n=20
Memory Used 939,429k (± 0.03%) 1,015,968k (± 0.01%) 🔻+76,539k (+ 8.15%) 1,015,553k 1,016,675k p=0.000 n=20
Memory Allocs 12,635,077 (± 0.03%) 15,907,879 (± 0.02%) 🔻+3,272,802 (+25.90%) 15,898,929 15,928,234 p=0.000 n=20
Config Time 0.002s 0.002s ~ ~ ~ p=1.000 n=20
Parse Time 0.147s (± 1.86%) 0.149s (± 2.22%) ~ 0.138s 0.174s p=0.357 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.865s (± 1.97%) 1.183s (± 0.59%) 🔻+0.318s (+36.79%) 1.163s 1.216s p=0.000 n=20
Emit Time 0.492s (± 1.97%) 0.509s (± 2.29%) +0.017s (+ 3.47%) 0.459s 0.547s p=0.042 n=20
Total Time 1.597s (± 0.81%) 1.934s (± 0.61%) 🔻+0.337s (+21.11%) 1.896s 2.009s p=0.000 n=20
mui-docs - native
Errors 11,405 11,405 ~ ~ ~ p=1.000 n=20
Symbols 3,784,019 3,745,693 -38,326 (- 1.01%) ~ ~ p=0.000 n=20
Types 1,355,974 1,292,461 🟩-63,513 (- 4.68%) ~ ~ p=0.000 n=20
Memory Used 1,769,157k (± 0.06%) 2,355,727k (± 0.06%) 🔻+586,570k (+33.16%) 2,350,729k 2,362,054k p=0.000 n=20
Memory Allocs 25,751,249 (± 0.13%) 46,425,057 (± 0.07%) 🔻+20,673,808 (+80.28%) 46,305,744 46,597,622 p=0.000 n=20
Config Time 0.009s (± 2.52%) 0.009s (± 2.18%) ~ 0.008s 0.009s p=0.716 n=20
Parse Time 0.301s (± 1.40%) 0.300s (± 2.37%) ~ 0.263s 0.329s p=0.836 n=20
Bind Time 0.001s 0.001s (±34.77%) ~ 0.001s 0.005s p=1.000 n=20
Check Time 3.016s (± 0.63%) 4.953s (± 0.87%) 🔻+1.937s (+64.22%) 4.775s 5.186s p=0.000 n=20
Emit Time 0.246s (± 1.33%) 0.252s (± 8.48%) +0.006s (+ 2.23%) 0.225s 0.388s p=0.014 n=20
Total Time 4.079s (± 0.56%) 6.019s (± 0.68%) 🔻+1.940s (+47.57%) 5.929s 6.305s p=0.000 n=20
sentry - native
Errors 2 3 🔻+1 (+50.00%) ~ ~ p=0.000 n=20
Symbols 4,793,245 4,780,779 -12,466 (- 0.26%) ~ ~ p=0.000 n=20
Types 2,606,905 2,536,142 -70,763 (- 2.71%) ~ ~ p=0.000 n=20
Memory Used 2,846,141k (± 0.03%) 3,074,910k (± 0.03%) 🔻+228,769k (+ 8.04%) 3,071,117k 3,078,986k p=0.000 n=20
Memory Allocs 75,140,192 (± 0.36%) 84,474,429 (± 0.31%) 🔻+9,334,237 (+12.42%) 83,951,658 85,589,151 p=0.000 n=20
Config Time 0.026s (± 0.79%) 0.026s (± 0.89%) ~ 0.026s 0.027s p=0.501 n=20
Parse Time 0.518s (± 8.15%) 0.491s (± 4.59%) ~ 0.436s 0.643s p=0.417 n=20
Bind Time 0.176s (±10.76%) 0.178s (±10.44%) ~ 0.133s 0.256s p=0.995 n=20
Check Time 7.021s (± 0.59%) 8.232s (± 0.56%) 🔻+1.211s (+17.25%) 8.060s 8.449s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 7.794s (± 0.74%) 8.984s (± 0.70%) 🔻+1.190s (+15.27%) 8.778s 9.236s p=0.000 n=20
social-app - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,883,074 1,905,657 +22,583 (+ 1.20%) ~ ~ p=0.000 n=20
Types 1,158,168 1,165,271 +7,103 (+ 0.61%) ~ ~ p=0.000 n=20
Memory Used 966,839k (± 0.01%) 1,075,252k (± 0.01%) 🔻+108,413k (+11.21%) 1,074,815k 1,075,931k p=0.000 n=20
Memory Allocs 13,509,034 (± 0.22%) 17,764,359 (± 0.25%) 🔻+4,255,325 (+31.50%) 17,692,748 18,046,398 p=0.000 n=20
Config Time 0.008s (± 1.82%) 0.008s (± 1.82%) ~ 0.007s 0.008s p=1.000 n=20
Parse Time 0.180s (± 5.61%) 0.179s (± 5.35%) ~ 0.153s 0.246s p=0.857 n=20
Bind Time 0.050s (±11.47%) 0.045s (± 8.92%) ~ 0.039s 0.077s p=0.118 n=20
Check Time 1.548s (± 1.99%) 2.076s (± 1.68%) 🔻+0.529s (+34.15%) 1.949s 2.238s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.804s (± 1.92%) 2.326s (± 1.58%) 🔻+0.522s (+28.91%) 2.198s 2.500s p=0.000 n=20
strada-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,184,972 1,186,616 +1,644 (+ 0.14%) ~ ~ p=0.000 n=20
Types 438,959 437,306 -1,653 (- 0.38%) ~ ~ p=0.000 n=20
Memory Used 1,168,821k (± 0.22%) 1,236,045k (± 0.27%) 🔻+67,224k (+ 5.75%) 1,219,892k 1,255,324k p=0.000 n=20
Memory Allocs 47,504,318 (± 0.08%) 54,063,076 (± 0.05%) 🔻+6,558,758 (+13.81%) 53,965,768 54,192,344 p=0.000 n=20
Config Time 0.002s (±15.67%) 0.002s (±12.34%) ~ 0.001s 0.003s p=0.418 n=20
Parse Time 0.140s (± 2.31%) 0.141s (± 1.84%) ~ 0.129s 0.150s p=0.702 n=20
Bind Time 0.000s 0.000s (±208.60%) ~ 0.000s 0.001s p=1.000 n=20
Check Time 0.799s (± 0.52%) 0.942s (± 0.47%) 🔻+0.142s (+17.81%) 0.928s 0.963s p=0.000 n=20
Emit Time 0.139s (± 1.14%) 0.137s (± 0.80%) -0.002s (- 1.47%) 0.131s 0.140s p=0.029 n=20
Total Time 9.331s (± 0.53%) 10.385s (± 0.46%) 🔻+1.055s (+11.30%) 10.236s 10.661s p=0.000 n=20
strada-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 263,511 263,733 +222 (+ 0.08%) ~ ~ p=0.000 n=20
Types 196,116 195,818 -298 (- 0.15%) ~ ~ p=0.000 n=20
Memory Used 223,533k (± 0.02%) 239,287k (± 0.01%) 🔻+15,754k (+ 7.05%) 239,129k 239,421k p=0.000 n=20
Memory Allocs 2,388,520 (± 0.01%) 2,816,004 (± 0.01%) 🔻+427,484 (+17.90%) 2,815,196 2,816,908 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.050s (± 2.96%) 0.051s (± 3.17%) ~ 0.046s 0.058s p=0.930 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.368s (± 0.70%) 0.429s (± 0.58%) 🔻+0.061s (+16.54%) 0.422s 0.440s p=0.000 n=20
Emit Time 0.048s (± 5.30%) 0.051s (± 6.28%) ~ 0.042s 0.065s p=0.193 n=20
Total Time 0.494s (± 0.69%) 0.558s (± 0.53%) 🔻+0.064s (+12.93%) 0.548s 0.573s p=0.000 n=20
t3code-server - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 4,350,661 4,283,060 -67,601 (- 1.55%) ~ ~ p=0.000 n=20
Types 3,040,644 3,016,451 -24,193 (- 0.80%) ~ ~ p=0.000 n=20
Memory Used 2,417,400k (± 0.02%) 2,720,850k (± 0.02%) 🔻+303,450k (+12.55%) 2,718,807k 2,724,832k p=0.000 n=20
Memory Allocs 37,173,527 (± 0.11%) 54,364,231 (± 0.06%) 🔻+17,190,703 (+46.24%) 54,296,137 54,552,967 p=0.000 n=20
Config Time 0.003s 0.003s (± 3.54%) ~ 0.002s 0.003s p=1.000 n=20
Parse Time 0.252s (± 1.91%) 0.255s (± 1.67%) ~ 0.241s 0.274s p=0.213 n=20
Bind Time 0.083s (± 9.76%) 0.087s (± 9.44%) ~ 0.073s 0.139s p=0.439 n=20
Check Time 5.974s (± 1.72%) 8.439s (± 1.55%) 🔻+2.465s (+41.25%) 7.958s 8.722s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 6.323s (± 1.67%) 8.795s (± 1.54%) 🔻+2.472s (+39.10%) 8.285s 9.112s p=0.000 n=20
tanstack-router - native
Errors 1 1 ~ ~ ~ p=1.000 n=20
Symbols 571,756 570,271 -1,485 (- 0.26%) ~ ~ p=0.000 n=20
Types 397,689 391,059 -6,630 (- 1.67%) ~ ~ p=0.000 n=20
Memory Used 326,453k (± 0.02%) 360,984k (± 0.02%) 🔻+34,531k (+10.58%) 360,761k 361,214k p=0.000 n=20
Memory Allocs 4,339,125 (± 0.20%) 5,432,212 (± 0.14%) 🔻+1,093,088 (+25.19%) 5,414,800 5,461,739 p=0.000 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.041s (± 4.12%) 0.040s (± 4.57%) ~ 0.034s 0.047s p=0.488 n=20
Bind Time 0.013s (±11.55%) 0.012s (± 8.91%) ~ 0.010s 0.019s p=0.913 n=20
Check Time 0.498s (± 0.65%) 0.647s (± 0.63%) 🔻+0.149s (+29.93%) 0.631s 0.665s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.570s (± 0.80%) 0.719s (± 0.56%) 🔻+0.149s (+26.12%) 0.704s 0.736s p=0.000 n=20
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=20
Symbols 231,616 231,759 +143 (+ 0.06%) ~ ~ p=0.000 n=20
Types 181,195 181,047 -148 (- 0.08%) ~ ~ p=0.000 n=20
Memory Used 193,023k (± 0.01%) 207,199k (± 0.01%) 🔻+14,176k (+ 7.34%) 207,099k 207,341k p=0.000 n=20
Memory Allocs 1,310,342 (± 0.02%) 1,688,280 (± 0.02%) 🔻+377,938 (+28.84%) 1,687,127 1,689,848 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.049s (± 3.79%) 0.049s (± 3.83%) ~ 0.044s 0.058s p=0.692 n=20
Bind Time 0.024s (± 4.74%) 0.023s (± 4.89%) ~ 0.019s 0.027s p=0.138 n=20
Check Time 0.322s (± 0.94%) 0.380s (± 1.11%) 🔻+0.058s (+18.02%) 0.369s 0.405s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.401s (± 0.96%) 0.459s (± 1.14%) 🔻+0.058s (+14.36%) 0.441s 0.483s p=0.000 n=20
vscode - native
Errors 11 12 🔻+1 (+ 9.09%) ~ ~ p=0.000 n=20
Symbols 7,581,393 7,409,825 -171,568 (- 2.26%) ~ ~ p=0.000 n=20
Types 4,453,103 4,223,626 🟩-229,477 (- 5.15%) ~ ~ p=0.000 n=20
Memory Used 5,238,870k (± 0.01%) 5,410,766k (± 0.02%) +171,895k (+ 3.28%) 5,407,037k 5,413,361k p=0.000 n=20
Memory Allocs 57,460,124 (± 0.01%) 68,502,245 (± 0.02%) 🔻+11,042,120 (+19.22%) 68,476,208 68,590,077 p=0.000 n=20
Config Time 0.038s (± 1.78%) 0.038s (± 1.20%) ~ 0.036s 0.039s p=0.605 n=20
Parse Time 0.938s (± 1.31%) 0.947s (± 2.19%) ~ 0.844s 1.027s p=0.465 n=20
Bind Time 0.351s (± 7.68%) 0.362s (± 9.33%) ~ 0.292s 0.567s p=0.952 n=20
Check Time 7.945s (± 1.56%) 9.364s (± 1.45%) 🔻+1.419s (+17.86%) 8.645s 9.814s p=0.000 n=20
Emit Time 2.970s (± 5.87%) 3.369s (± 4.07%) 🔻+0.399s (+13.45%) 2.990s 4.186s p=0.000 n=20
Total Time 12.303s (± 1.97%) 14.143s (± 1.64%) 🔻+1.840s (+14.96%) 13.304s 15.144s p=0.000 n=20
webpack - native
Errors 612 620 +8 (+ 1.31%) ~ ~ p=0.000 n=20
Symbols 925,190 1,082,647 🔻+157,457 (+17.02%) ~ ~ p=0.000 n=20
Types 643,199 2,133,243 🔻+1,490,044 (+231.66%) ~ ~ p=0.000 n=20
Memory Used 697,711k (± 0.02%) 1,371,751k (± 0.01%) 🔻+674,040k (+96.61%) 1,371,408k 1,372,322k p=0.000 n=20
Memory Allocs 6,473,690 (± 0.05%) 47,254,840 (± 0.01%) 🔻+40,781,151 (+629.95%) 47,247,152 47,271,226 p=0.000 n=20
Config Time 0.004s 0.004s ~ ~ ~ p=1.000 n=20
Parse Time 0.143s (± 3.09%) 0.147s (± 3.62%) ~ 0.126s 0.170s p=0.298 n=20
Bind Time 0.049s (±12.18%) 0.046s (± 9.74%) ~ 0.039s 0.072s p=0.825 n=20
Check Time 0.982s (± 0.54%) 72.903s (± 1.96%) 🔻+71.921s (+7,322.82%) 66.626s 79.005s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.201s (± 0.76%) 73.124s (± 1.96%) 🔻+71.923s (+5,988.87%) 66.840s 79.236s p=0.000 n=20
xstate-main - native
Errors 0 1 🔻+1 (+ ∞%) ~ ~ p=0.000 n=20
Symbols 640,490 856,593 🔻+216,103 (+33.74%) ~ ~ p=0.000 n=20
Types 387,984 457,702 🔻+69,718 (+17.97%) ~ ~ p=0.000 n=20
Memory Used 350,159k (± 0.02%) 455,995k (± 0.01%) 🔻+105,835k (+30.22%) 455,690k 456,211k p=0.000 n=20
Memory Allocs 3,968,869 (± 0.10%) 11,780,642 (± 0.03%) 🔻+7,811,773 (+196.83%) 11,766,097 11,790,998 p=0.000 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.064s (± 4.85%) 0.064s (± 5.34%) ~ 0.054s 0.082s p=0.835 n=20
Bind Time 0.020s (±11.79%) 0.021s (± 9.16%) ~ 0.017s 0.032s p=0.439 n=20
Check Time 0.406s (± 1.92%) 0.909s (± 1.89%) 🔻+0.503s (+123.95%) 0.875s 1.034s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.496s (± 1.97%) 1.000s (± 2.01%) 🔻+0.504s (+101.72%) 0.962s 1.143s p=0.000 n=20
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • arktype - native
  • class-transformer - native
  • effect - native
  • mui-docs - native
  • sentry - native
  • social-app - native
  • strada-build-src - native
  • strada-compiler - native
  • t3code-server - native
  • tanstack-router - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 20
Baseline baseline 20

Developer Information:

Download Benchmarks

@jakebailey

Copy link
Copy Markdown
Member Author

Well, that's a little bleak.

@jakebailey

Copy link
Copy Markdown
Member Author

Not sure why top400 didn't come back either

Checker results should not depend on which files were checked first,
or on which types an editor happened to ask for before diagnostics
were requested. Tests had no way to show such dependence, so fixes for
it could only be described, not demonstrated.

The harness-only checkOrder option queries the checker in a different
order: files in reverse, each file in its own program, or every
expression's type and symbol before any diagnostics. Listing several
orders produces a baseline for each, so order dependence shows up as
differing baselines.
The checkOrder option only tries a few fixed orders over whole files,
but results can depend on which single query a checker answers first,
as when an editor asks for the type of one node before anything else
is checked. Such dependence is hard to find by hand and easy to
reintroduce.

With TS_CHECK_ORDER_FUZZ=n, each test is checked again n times in fresh
programs that first answer a seeded random selection of type, symbol,
and diagnostics queries. Any change in diagnostics or in the type or
symbol of a node fails the test with the seed and a minimized list of
queries that reproduces it. The fuzzer is off by default, so it does
not slow the normal suite.
Asking the checker for types and symbols before requesting diagnostics
changes the diagnostics and types reported for these tests. Recording
them in that order too shows which later changes make the results
independent of what was asked first.
These tests exercise checker results that can depend on the order in
which declarations, files, and relations are checked: variance
measurement cycles, relation caching under recursion and depth
limits, instantiation limits, contextual re-checks, and deferred type
reference cycles.

Recording the current baselines makes later changes to make checking
order independent show up as reviewable baseline diffs.
Variance measured through a cycle of recursive references used to
depend on which type in the cycle was measured first, so reordering
declarations or assignments changed which assignments were errors.
These cases cover cycles through interfaces, type aliases, callbacks,
and nested compositions, alongside annotated and structurally measured
types whose results should not change.
The errors for a getter and setter that disagree on abstractness or
accessibility were reported on both names by whichever accessor was
checked first, guarded by a flag on the getter. When that happened
during a query rather than a full check, the flag was set without the
errors being reported. Since the errors only depend on the modifiers,
each accessor now reports the error on its own name with no state,
which yields the same set of errors in any order.
The type parameters of a type alias are resolved along with its
declared type, but some readers took them from the links without
resolving the declared type first, relying on it having been resolved
earlier. Reading them through an accessor that resolves the declared
type makes the dependency explicit, so the result does not depend on
what was resolved before.
checkAssertion runs in several check modes, such as when a call is
first checked without its context sensitive arguments, and each run
overwrote the operand type kept for the deferred comparability check.
That check used whichever was stored last, so its result depended on
the order in which the assertion was checked.

The deferred check now uses the cached normal type of the operand. The
assertion itself only needs the operand type for `as const`, and the
operand of a non-const assertion is contextually typed by the asserted
type alone, so in any check mode the assertion computes the cached
type the deferred check will read, with inference for an enclosing
call hidden from the operand. This is the result the deferred check
would produce on its own, and checks each operand once rather than
again with fresh flow analysis in the deferred check.
The type of a destructured parameter's binding elements depended on
whether the parameter's type happened to be cached already. For
example, in non-strict mode

    (({ [a()?.d]: c = "" }) => {})();

reported TS2537 when 'c' was queried before the IIFE call resolved
the parameter (its declared type is the undefined widening type),
but not otherwise. Conversely, in

    f7({ a: {} });
    function f7({ a: { x = 0, y = 0 } } = { a: {} }) {}

calling f7 first made 'x' and 'y' errors of type any.

Make the choice depend only on the declaration. Parameters of
context-sensitive functions take their type from contextual
assignment, so ask for the parameter's type. Everything else uses
the type derived from the declaration, as it did when nothing was
cached. Asking for the parameter's type unconditionally instead
introduces circularities in patterns whose initializers reference
sibling elements.
Asking for the type of a context-sensitive function's parameter can
resolve the enclosing call, which assigns the parameter its
contextual type from the inference in progress. The first query
nevertheless returned the type it computed itself from the final
signature, while every later query returned the assigned type. In

    declare function fun<T>(g: (x: T) => T, h: (y: T) => T, x: T): T;
    fun((Math.random() < 0.5 ? (x => x) : (x => undefined)), x => x, 10);

the last 'x' was number when the call was checked first, but any
when 'x' was queried first and its result was cached.

Return the assigned type whenever one exists, so that the first
query agrees with the rest, as the original comment intended.
When resolving a function expression's members reaches the function
again through its enclosing call, the contextual check sees an empty
signature list and gives up, yet it left the node marked as context
checked. Whichever query got there first therefore decided whether the
function's parameters were ever contextually typed, and diagnostics
such as implicit any errors could be lost depending on check order.

Leave the node unchecked in that case so a later request performs the
check, and have the deferred function check request it, so that the
check is performed at least once whichever query reached it first.
Generic calls nested in the arguments of other generic calls, or in
context sensitive functions passed to them, depend on the enclosing
call for their contextual type and parameter types, and the enclosing
call infers from them in turn. When the inner call was queried first,
it was already marked as resolving by the time its contextual type
resolved the enclosing call, so the enclosing inference saw a
placeholder and both calls cached results that a check in source order
never produces.

Computing the contextual type of a call nested in an argument of an
enclosing call before resolving it resolves the enclosing call first,
as source order does. Other contexts are not resolved ahead of time,
since computing them may evaluate expressions that checking does not,
such as the target of a destructuring assignment.
Asking for the symbol of a property access that hits an index signature
stored the index symbol as the access's resolved symbol. Checking a
delete expression reads that link to decide whether the operand must be
optional, so a prior symbol query turned `delete a.x` on an index
signature into an error that a plain check does not report.

The type of the index symbol at such an access, which hovers show, is
found by comparing it to the symbol the access resolved to, so that
comparison now looks the index symbol up again rather than reading it
from links.
A context-sensitive function's signature takes the type parameters of
a generic contextual signature, and its parameters their types, when
the function is contextually checked. Anything reading the signature
before then saw it incomplete and cached what it derived from it. Type
aliases in the body read the type parameters as outer type parameters,
so querying such an alias first resolved its conditional types eagerly.
In

    declare function f(fun: <T>(t: T) => void): void
    f(function self(t) {
        const s = self;
        type P = Parameters<typeof s>;
    });

P was [t: unknown] when the call was checked first, but [t: T] when P
was asked for first, since s then had the uncontextual signature.

Split out assigning the contextual parameter types, which completes
the signature, from the rest of the contextual check, and have every
way to obtain the signature request it: the type of the function's
symbol, before anything resolves its members, and the signature of its
declaration. The rest of the check, inferring the return type and
checking the signature, remains for checking the function itself.

Contextual typing can reach the enclosing call while the signature is
being created, so keep the signature created there rather than replace
the one that was contextually typed. This also makes it unnecessary to
leave a function unchecked when its members are found being resolved.
A single signature type produced by higher order inference is
instantiated with the full mapper combined in, since its signature can
reference type parameters other than the outer type parameters of its
declaration. The instantiation cache was keyed only by the mapped outer
type parameters, so two instantiations differing in another type
parameter (here the this type) shared whichever result was computed
first. Which property access was checked first therefore decided the
type of both, and checking `outer.log` gave it the type of `inner.log`
contrary to the test's expectation.
Explaining why a name failed to resolve looks up other symbols, for
example to find a spelling suggestion, and that can resolve aliases.
When the failed name was the target of an alias, the suggestion lookup
re-entered the alias being resolved, or skipped it, depending on which
aliases were already in progress. In declarationEmitUnknownImport that
decided whether two "Circular definition of import alias" errors were
reported: they appeared when the import was checked first, and not
when the export specifier was resolved first.

Defer the explanation until no resolution is in progress, so it only
observes finished results. The circularity errors that were artifacts
of the suggestion lookup are no longer reported.
When one reference hit the flow analysis depth limit, flow analysis
was disabled for every later reference in the same function or module
body. The type of a reference then depended on whether another
reference in the body had been analyzed before it.

Each reference now gives up only when its own analysis hits the limit,
so its type is the one it would get if it were analyzed first.
Its last use was in reportNonexistentProperty, which kept both a set of
(name, containing type, JS) keys and the flag on the name's node. The
flag already stopped a second report for the node on any containing
type, so the keyed set never caught anything the flag did not.

Keep a single set of reported name nodes instead. Reports only run
while checking, so this stays checking-only state, as the keyed set was.
Measuring variances as a fixpoint changed the language: a type whose
recursive references nest its type parameters, such as

    interface Foo1<T> { x: T; y: Foo1<(arg: T) => void> }

was measured invariant instead of covariant. On zod, the stricter
variances of ZodObject failed constraints (TS2344), sent comparisons
into deep structural recursion (TS2589), and made checking 250x slower.

Go back to TypeScript's rule: a recursive reference to a type being
measured has unknown variances, so occurrences nested in it are not
measured. That result depends on where the circularity is entered, so it
is measured from a canonical entry, the type with the smallest symbol,
as before the fixpoint.

The entry was not always found, though. A reference to a type measured
further down the variance stack counted as one of its marker types and
was compared structurally, never reaching its variances, so no
circularity was seen and the result depended on which type was measured
first. Only the measurement at the top of the stack has marker types
now; references to the others find the circularity and restart from the
canonical entry.

The variance tests now match TypeScript, except where TypeScript reports
a circularity that a different check order avoids in TypeScript too.
Each reentry of a computation in progress made every computation above
it depend on it. addDep avoids duplicates only for the computation the
dependency was most recently added to, so with several cycle heads in
progress, as when relating deeply recursive types, every reentry walked
the whole stack and appended the head again to each computation on it:
on zod v4, 1.5M appends from 114K reentries, a quarter of all memory
allocated.

Walk down from the top instead, and stop at the first computation that
an earlier reentry already made depend on the same head: the
computations below it were in progress then too, so they already depend
on it. Each computation records which of its dependencies memoCycle
added, so other dependencies on the head do not stop the walk early.

PERF-PLACEHOLDER
Once a cycle is detected inside a check, the outermost computation in
progress switches to recording its effects as a query does, and stays
that way until it finishes, even though the cycle usually closes long
before. Every read after that pays for dependency accounting.

When the last cycle, inner cycle, effects mark and discard log entry
are gone, nothing computed since can be discarded anymore, so the
effects recorded so far are replayed at the node each computation
started at, as they would be when the outermost one finishes, and
checking resumes applying effects directly.

PERF-PLACEHOLDER
A measurement of variances re-entering one in progress marked the
whole measurement circular, so everything computed until it finished
was recorded as a query and then thrown away, even though almost none
of it depends on variances. On zod, nearly all reads in a check were
made under such a cycle, and a third of the instantiations were
recomputations.

Only comparisons and inferences read variances. As TypeScript does for
Ternary.Unknown, a comparison that observed incomplete variances is
not cached, nor is any comparison in progress around it. Once the
outermost comparison completes, its result escapes to whatever asked,
and only then is the measurement re-entered marked circular, so that
what reads that result is discarded when it finishes. Comparisons made
by a measurement itself are exempt: the variances measured are kept as
before, since each is measured from the canonical entry whichever type
is entered first. An inference reading incomplete variances marks the
measurement circular right away.

PERF-PLACEHOLDER
When a circularity among variance measurements restarts from its
canonical entry, the restart sets the variances of each type it
measures, and the measurements in progress below it only finish to
throw their results away. Their comparisons read incomplete variances,
so none of them is cached, and on zod's cluster of a dozen mutually
recursive types, which restarts from a new canonical entry each time
the cycle grows, that redone work was a tenth of all comparisons.

A comparison that is part of a measurement whose variances are now set
stops at once, as reading the incomplete variances of the measurement,
so that what it compared is still not cached and the result is the
same.

PERF-PLACEHOLDER
Re-entering a memo map entry searched the whole resolution stack for
the resolution computing it. Relation and instantiation maps keep
hundreds of entries in progress during deep comparisons, so each
begin paid for a scan of the stack per matching key. Each entry in
progress now records the index of its resolution.

PERF-PLACEHOLDER
Once any result has reports to replay, every read in a check looked
for the result's memo state, through a filter sized for all states,
which mostly misses cache. In a check with no effects pending, only
reports are replayed, and few results have them, so a small filter of
the keys with reports, and a flag per memo map, rule out nearly every
read first.

PERF-PLACEHOLDER
Chains that start a new memoized computation at every level, such as
conditional types that compare instantiations of themselves, never
reach the limit on one computation's depth and only stop at the limit
on the whole instantiation. TypeScript stops every instantiation at a
depth of 100, so a program it accepts never nests this deeply; the
larger limit only needs to leave room for computations started below
100 to reach their own limit. At 1000, each runaway chain in zod v4
nested ten times deeper than TypeScript before stopping, with the
same errors at any limit from 150 up.

PERF-PLACEHOLDER
Few results have a memo state (about two thousand in zod v4), yet every
computation probes the filter of their keys, which at four million bits
missed the cache on most probes. Grow the filter with the states,
keeping enough bits per state for few false positives.

PERF-PLACEHOLDER
Cycle searches visit the resolution of every variance measurement on
the stack, and each visit looks up the symbol's variances in a hash map.
The symbol link store indexes by symbol id instead, as other symbol
links do.

PERF-PLACEHOLDER
Most memo frames on large programs wrap a read of a result that is
already cached: the type of a type node, a type parameter's constraint
or default, a symbol's declared type, members or exports, a module's
exports. Beginning and ending the memo costs a hash insert and delete
and a stack push for each.

When no memo is active, a memo records and replays nothing, and a
cached read enters no computation, so skipping the memo changes
nothing, unless the computation is in progress: a class or interface
publishes its declared type before it is complete, and re-entering it
must still find the cycle. A type node's type is only read from its
links where getConditionalFlowTypeOfType would leave it unchanged.

PERF-PLACEHOLDER
Once any result has reports to replay, which happens early in most
programs, every cached read while checking went out of line to the
error filter. Only a type alias's declared type and the instantiations
of type aliases and conditional types collect reports, so reads of
other results now only account for pending effects. The alias's
declared type gets its own kind of memo, which still looks for them.

PERF-PLACEHOLDER
Whether a member can late-merge depends only on its parent, so keying
the dense store by member filled one entry per member and missed for
every new member of an already-seen parent. Key it by parent instead,
which also makes the lateBindableKinds memo map redundant, so drop it.

Members of one parent are usually looked up together, so also keep the
last parent and its kinds on the checker. This is per-checker scratch
and stays off the shared memo store.

PERF-PLACEHOLDER
Beginning a computation in a check looked up the memo state of its
result up front, though in the common case nothing reads it: the state
is created lazily when the computation has effects to retain, and
otherwise only compared against in attachState. For memo maps keyed by
relation keys that lookup misses the cache, since the filter of keys
with a state is large.

Leave the state unset on the fast path, and have attachState peek it
when it needs to compare. Peeking later can only find a state created
since the computation began, which the computation's own writers
already skip, so the comparison gives the same answer.

PERF-PLACEHOLDER
Each call of a global type or symbol resolver looked up its result in
the store by a key holding the global's name, hashing the string every
time. Assigning each key an integer when its resolver is created lets
the result live in a memo at that index instead, with no lookup at
all. Resolvers are only created as a checker is initialized, in the
same order, so checkers sharing a store agree on the integers, and the
memos can be allocated once, after the first checker created them.

PERF-PLACEHOLDER
Callers passing an error node computed awaited and promised types in
their own context, so their errors belong to their node, but this also
meant they never reused a cached result. Awaiting in async functions
passes an error node, so most awaited types were computed again at
every use.

A promised type reports errors only when there is none, so a result is
shared with every caller. An awaited type can report errors alongside a
result, for a union some of whose members cannot be awaited, so only a
result whose computation reported nothing is cached. Callers with an
error node then reuse it, and compute in their own context only when
there is no such result.

PERF-PLACEHOLDER
Resolving a call nested in an argument of another call first computes
its contextual type, so that the enclosing call is resolved first, as
in source order. Checking in source order has nearly always resolved or
begun resolving the enclosing call by then, and computing the contextual
type again only to find that cost a walk through the enclosing call
for every nested call. The enclosing call is now found directly, and
the contextual type only computed when it is not yet resolving.

PERF-PLACEHOLDER
Interning object literal types by content hashed every property name and
type of each literal checked into a key, and looked the key up in a map
keyed by that hash. The key starts with the node, so the types created
for one literal are only ever compared with each other.

Keep the types created for each object literal node instead, and compare
their content with the new content directly. Few literals are checked
more than once, so this is usually an empty list, and nothing is hashed.
Comparing content directly also cannot confuse two contents whose hashes
collide.

PERF-PLACEHOLDER
Every checked node pushed a resolution so that results depending on
errors located at it are discarded when it is left. Most nodes are
checked directly within another, with nothing in between and no cycle
in progress, and then the enclosing node's resolution can stand in:
a cycle through the inner node can only start at that resolution while
the inner node is current, and leaving the inner node ends it exactly
where popping its own resolution would have. Results are unchanged;
three quarters of the pushes go away.

PERF-PLACEHOLDER
@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) test it

@typescript-automation

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), this PR is in an unmergable state, so is missing a merge commit to run against; please resolve conflicts and try again.

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) test it

@typescript-automation

typescript-automation Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top400 ✅ Started 👀 Results
user test this ✅ Started 👀 Results
run dt ✅ Started 👀 Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), the results of running the DT tests are ready.

There were interesting changes:

Branch only errors: d3-selection

Package: d3-selection

Branch error:

Project scope: tsconfig.json

Error: types/d3-selection/d3-selection-tests.ts:1502:9
TypeScript@local compile error TS2769:
No overload matches this call.
The last overload gave the following error.
Argument of type '(enter: Selection<EnterElement, number, HTMLElement, unknown>) => TransitionLike<HTMLParagraphElement, number>' is not assignable to parameter of type 'string | ((elem: Selection<EnterElement, number, HTMLElement, unknown>) => Selection<BaseType, number, HTMLElement, unknown> | TransitionLike<...>)'.
Type '(enter: Selection<EnterElement, number, HTMLElement, unknown>) => TransitionLike<HTMLParagraphElement, number>' is not assignable to type '(elem: Selection<EnterElement, number, HTMLElement, unknown>) => Selection<BaseType, number, HTMLElement, unknown> | TransitionLike<...>'.
Type 'TransitionLike<HTMLParagraphElement, number>' is not assignable to type 'Selection<BaseType, number, HTMLElement, unknown> | TransitionLike<HTMLElement, number>'.
Type 'TransitionLike<HTMLParagraphElement, number>' is not assignable to type 'TransitionLike<HTMLElement, number>'.
The types returned by 'selection().merge' are incompatible between these types.
Type '(other: Selection<HTMLParagraphElement, number, any, any> | TransitionLike<HTMLParagraphElement, number>) => Selection<...>' is not assignable to type '(other: Selection<HTMLElement, number, any, any> | TransitionLike<HTMLElement, number>) => Selection<HTMLElement, number, any, any>'.
Types of parameters 'other' and 'other' are incompatible.
Type 'Selection<HTMLElement, number, any, any> | TransitionLike<HTMLElement, number>' is not assignable to type 'Selection<HTMLParagraphElement, number, any, any> | TransitionLike<HTMLParagraphElement, number>'.
Type 'Selection<HTMLElement, number, any, any>' is not assignable to type 'Selection<HTMLParagraphElement, number, any, any> | TransitionLike<HTMLParagraphElement, number>'.
Type 'Selection<HTMLElement, number, any, any>' is not assignable to type 'Selection<HTMLParagraphElement, number, any, any>'.
Types of property 'select' are incompatible.
Type '{ <DescElement extends BaseType>(selector: string): import("/mnt/vss/_work/1/s/DefinitelyTyped/types/d3-selection/index").Selection<DescElement, number, any, any>; <DescElement extends BaseType>(selector: null): import("/mnt/vss/_work/1/s/DefinitelyTyped/types/d3-selection/index").Selection<...>; <DescElement extend...' is not assignable to type '{ <DescElement extends BaseType>(selector: string): import("/mnt/vss/_work/1/s/DefinitelyTyped/types/d3-selection/index").Selection<DescElement, number, any, any>; <DescElement extends BaseType>(selector: null): import("/mnt/vss/_work/1/s/DefinitelyTyped/types/d3-selection/index").Selection<...>; <DescElement extend...'. Two different types with this name exist, but they are unrelated.
Types of parameters 'selector' and 'selector' are incompatible.
Types of parameters 'groups' and 'groups' are incompatible.
Type 'HTMLElement[] | ArrayLike<HTMLElement>' is not assignable to type 'HTMLParagraphElement[] | ArrayLike<HTMLParagraphElement>'.
Type 'HTMLElement[]' is not assignable to type 'HTMLParagraphElement[] | ArrayLike<HTMLParagraphElement>'.
Type 'HTMLElement[]' is not assignable to type 'HTMLParagraphElement[]'.
Property 'align' is missing in type 'HTMLElement' but required in type 'HTMLParagraphElement'.
    at combineErrorsAndWarnings (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:200:28)
    at runTests (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:192:20)
Branch only errors: react-relay

Package: react-relay

Branch error:

Project scope: tsconfig.json

Error: types/react-relay/test/relay-hooks-tests.tsx:987:13
TypeScript@local compile error TS2344:
Type '{ mainPanelA?: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params> | undefined; mainPanelB?: EntryPoint<...> | undefined; }' does not satisfy the constraint 'Record<string, EntryPoint<any, any> | undefined>'.
Property 'mainPanelA' is incompatible with index signature.
Type 'EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>' is not assignable to type 'InternalEntryPointRepresentation<any, Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Types of property 'root' are incompatible.
Type 'JSResourceReference<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>' is not assignable to type 'JSResourceReference<EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>'.
Type 'EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'ComponentClass<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of property 'getDerivedStateFromProps' are incompatible.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any> | undefined' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any> | undefined'.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of parameters 'nextProps' and 'nextProps' are incompatible.
Type 'Readonly<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>' is not assignable to type 'Readonly<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>'.
Types of property 'extraProps' are incompatible.
Type '{} | null' is not assignable to type '{}'.
Type 'null' is not assignable to type '{}'.

types/react-relay/test/relay-hooks-tests.tsx:1023:13
TypeScript@local compile error TS2322:
Type '(params: { route: string; }) => { entryPoints: { mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: ...; }; mainPanelB?: undefined; } | ...; queries: ...; extraProps: ...; }' is not assignable to type '(entryPointParams: { route: string; }) => PreloadProps<{ route: string; }, {}, Record<string, EntryPoint<any, any> | undefined>, { foo: "bar"; }>'.
Type '{ entryPoints: { mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: { slug: string; }; }; mainPanelB?: undefined; } | ...; queries: {}; extraProps: ...; }' is not assignable to type 'PreloadProps<{ route: string; }, {}, Record<string, EntryPoint<any, any> | undefined>, { foo: "bar"; }>'.
Types of property 'entryPoints' are incompatible.
Type '{ mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: ...; }; mainPanelB?: undefined; } | ...' is not assignable to type 'ThinNestedEntryPointParamsObject<Record<string, EntryPoint<any, any> | undefined>> | undefined'.
Type '{ mainPanelA: { entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: { slug: string; }; }; mainPanelB?: undefined; }' is not assignable to type 'ThinNestedEntryPointParamsObject<Record<string, EntryPoint<any, any> | undefined>>'.
Property 'mainPanelA' is incompatible with index signature.
Type '{ entryPoint: EntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>, Params>; entryPointParams: { slug: string; }; }' is not assignable to type 'ThinNestedEntryPointParams<EntryPoint<any, any> | undefined>'.
The types of 'entryPoint.root' are incompatible between these types.
Type 'JSResourceReference<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>' is not assignable to type 'JSResourceReference<EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>'.
Type 'EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'EntryPointComponent<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>'.
Type 'ComponentClass<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'ComponentClass<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of property 'getDerivedStateFromProps' are incompatible.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any> | undefined' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any> | undefined'.
Type 'GetDerivedStateFromProps<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>, any>' is not assignable to type 'GetDerivedStateFromProps<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>, any>'.
Types of parameters 'nextProps' and 'nextProps' are incompatible.
Type 'Readonly<EntryPointProps<Record<string, OperationType>, Record<string, EntryPoint<any, any> | undefined>, {}, {} | null>>' is not assignable to type 'Readonly<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>'.
Types of property 'extraProps' are incompatible.
Type '{} | null' is not assignable to type '{}'.
Type 'null' is not assignable to type '{}'.

types/react-relay/test/relay-hooks-tests.tsx:1054:15
TypeScript@local compile error TS2322:
Type 'Readonly<{ dispose: DisposeFn; entryPoints: { [x: string]: Readonly<...>; }; extraProps: {} | null; getComponent: () => any; isDisposed: boolean; queries: { [x: string]: PreloadedQuery<OperationType, Record<...>>; }; rootModuleID: string; }>' is not assignable to type 'PreloadedEntryPoint<EntryPointComponent<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }>> | undefined'.
Type 'Readonly<{ dispose: DisposeFn; entryPoints: { [x: string]: Readonly<...>; }; extraProps: {} | null; getComponent: () => any; isDisposed: boolean; queries: { [x: string]: PreloadedQuery<OperationType, Record<...>>; }; rootModuleID: string; }>' is not assignable to type 'Readonly<{ dispose: DisposeFn; entryPoints: {}; extraProps: {}; getComponent: () => FunctionComponent<EntryPointProps<{ someQueryRef: SomeQuery; }, {}, { onClick: () => void; }, {}>>; isDisposed: boolean; queries: ...; rootModuleID: string; }>'.
Types of property 'extraProps' are incompatible.
Type '{} | null' is not assignable to type '{}'.
Type 'null' is not assignable to type '{}'.
    at combineErrorsAndWarnings (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:200:28)
    at runTests (/mnt/vss/_work/1/s/DefinitelyTyped-tools/packages/dtslint/dist/index.js:192:20)

Full output in the log.

@typescript-automation

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey) Here are the results of running the user tests with tsc comparing baseline and pr:

Something interesting changed - please have a look.

Details

effect

packages/tools/ai-docgen/tsconfig.json

uglify-js

/mnt/vss/work/1/s/ts_downloads//m/uglify-js/tsconfig.json

  • [NEW] error TS2339: Property 'last_ref' does not exist on type 'never'.
    • /mnt/vss/work/1/s/ts_downloads//m/uglify-js/node_modules/uglify-js/lib/compress.js(2544,35)
  • [MISSING] error TS2322: Type 'false' is not assignable to type 'never'.
    • /mnt/vss/work/1/s/ts_downloads//m/uglify-js/node_modules/uglify-js/lib/compress.js(2544,25)

webpack

tsconfig.json

  • [NEW] error TS2345: Argument of type '[unknown]' is not assignable to parameter of type '[] | [boldQuantity?: boolean | undefined] | [direction?: "child" | "parent" | "sibling" | undefined] | [oversize?: boolean | undefined]'.
  • [NEW] error TS2345: Argument of type 'string | number | boolean | Type' is not assignable to parameter of type 'Type'.

tsconfig.types.json

  • [NEW] error TS2345: Argument of type '[unknown]' is not assignable to parameter of type '[] | [boldQuantity?: boolean | undefined] | [direction?: "child" | "parent" | "sibling" | undefined] | [oversize?: boolean | undefined]'.

tsconfig.types.test.json

@typescript-automation

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=20
Symbols 88,466 88,464 -2 (- 0.00%) ~ ~ p=0.000 n=20
Types 79,607 79,569 -38 (- 0.05%) ~ ~ p=0.000 n=20
Memory Used 107,509k (± 0.03%) 109,739k (± 0.03%) +2,230k (+ 2.07%) 109,565k 109,940k p=0.000 n=20
Memory Allocs 1,262,217 (± 0.01%) 1,297,990 (± 0.01%) +35,772 (+ 2.83%) 1,297,588 1,298,546 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.023s (± 2.29%) 0.023s (± 3.24%) ~ 0.019s 0.027s p=0.868 n=20
Bind Time 0.008s (± 4.65%) 0.008s (± 5.20%) ~ 0.007s 0.009s p=0.250 n=20
Check Time 0.208s (± 0.86%) 0.225s (± 0.54%) 🔻+0.018s (+ 8.44%) 0.219s 0.230s p=0.000 n=20
Emit Time 0.132s (± 1.31%) 0.134s (± 0.91%) +0.002s (+ 1.75%) 0.130s 0.141s p=0.002 n=20
Total Time 0.374s (± 0.42%) 0.394s (± 0.45%) 🔻+0.020s (+ 5.27%) 0.385s 0.401s p=0.000 n=20
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=20
Symbols 586,553 580,825 -5,728 (- 0.98%) ~ ~ p=0.000 n=20
Types 241,682 238,891 -2,791 (- 1.15%) ~ ~ p=0.000 n=20
Memory Used 519,729k (± 0.02%) 835,446k (± 0.01%) 🔻+315,717k (+60.75%) 835,120k 835,702k p=0.000 n=20
Memory Allocs 7,794,013 (± 0.11%) 14,367,341 (± 0.04%) 🔻+6,573,329 (+84.34%) 14,358,229 14,407,785 p=0.000 n=20
Config Time 0.008s (± 2.79%) 0.008s (± 2.79%) ~ 0.008s 0.009s p=1.000 n=20
Parse Time 0.123s (± 3.74%) 0.123s (± 3.44%) ~ 0.114s 0.154s p=0.952 n=20
Bind Time 0.046s (±10.12%) 0.045s (±11.44%) ~ 0.035s 0.066s p=0.629 n=20
Check Time 0s 0s ~ ~ ~ p=1.000 n=20
Emit Time 0.649s (± 2.10%) 1.132s (± 0.84%) 🔻+0.483s (+74.53%) 1.102s 1.193s p=0.000 n=20
Total Time 0.838s (± 1.62%) 1.319s (± 1.06%) 🔻+0.481s (+57.41%) 1.281s 1.402s p=0.000 n=20
arktype - native
Errors 0 4 🔻+4 (+ ∞%) ~ ~ p=0.000 n=20
Symbols 685,920 693,349 +7,429 (+ 1.08%) ~ ~ p=0.000 n=20
Types 939,467 921,185 -18,282 (- 1.95%) ~ ~ p=0.000 n=20
Memory Used 495,347k (± 0.01%) 517,923k (± 0.01%) 🔻+22,576k (+ 4.56%) 517,630k 518,211k p=0.000 n=20
Memory Allocs 12,061,962 (± 0.01%) 12,440,391 (± 0.01%) +378,429 (+ 3.14%) 12,436,747 12,452,115 p=0.000 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.042s (± 3.73%) 0.041s (± 3.67%) ~ 0.034s 0.048s p=0.422 n=20
Bind Time 0.014s (±11.75%) 0.013s (± 8.91%) ~ 0.011s 0.020s p=0.662 n=20
Check Time 0.897s (± 0.59%) 1.049s (± 0.40%) 🔻+0.152s (+16.94%) 1.030s 1.064s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.981s (± 0.54%) 1.107s (± 0.42%) 🔻+0.126s (+12.84%) 1.088s 1.126s p=0.000 n=20
class-transformer - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 45,376 45,319 -57 (- 0.13%) ~ ~ p=0.000 n=20
Types 7,573 7,219 🟩-354 (- 4.67%) ~ ~ p=0.000 n=20
Memory Used 27,895k (± 0.02%) 28,255k (± 0.02%) +360k (+ 1.29%) 28,229k 28,282k p=0.000 n=20
Memory Allocs 248,354 (± 0.06%) 253,495 (± 0.06%) +5,141 (+ 2.07%) 252,977 254,243 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.011s (± 3.57%) 0.011s (± 3.85%) ~ 0.008s 0.012s p=0.495 n=20
Bind Time 0.003s (±10.28%) 0.003s (± 6.03%) ~ 0.002s 0.004s p=0.401 n=20
Check Time 0.008s (± 5.48%) 0.009s (± 6.56%) 🔻+0.001s (+14.84%) 0.007s 0.012s p=0.001 n=20
Emit Time 0.007s (± 6.78%) 0.008s (± 5.88%) ~ 0.006s 0.009s p=0.314 n=20
Total Time 0.030s (± 1.82%) 0.032s (± 2.42%) 🔻+0.001s (+ 4.27%) 0.027s 0.036s p=0.001 n=20
effect - native
Errors 12 20 🔻+8 (+66.67%) ~ ~ p=0.000 n=20
Symbols 1,235,115 1,232,773 -2,342 (- 0.19%) ~ ~ p=0.000 n=20
Types 894,113 888,476 -5,637 (- 0.63%) ~ ~ p=0.000 n=20
Memory Used 949,861k (± 0.02%) 978,931k (± 0.02%) +29,069k (+ 3.06%) 978,314k 979,543k p=0.000 n=20
Memory Allocs 12,642,015 (± 0.04%) 13,094,072 (± 0.03%) +452,057 (+ 3.58%) 13,086,793 13,118,087 p=0.000 n=20
Config Time 0.002s 0.002s (±10.62%) ~ 0.002s 0.004s p=0.487 n=20
Parse Time 0.161s (± 1.51%) 0.166s (± 5.47%) ~ 0.151s 0.231s p=1.000 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.959s (± 1.19%) 1.079s (± 0.62%) 🔻+0.119s (+12.45%) 1.051s 1.110s p=0.000 n=20
Emit Time 0.544s (± 2.17%) 0.555s (± 2.14%) ~ 0.502s 0.588s p=0.147 n=20
Total Time 1.769s (± 0.76%) 1.906s (± 0.90%) 🔻+0.136s (+ 7.70%) 1.840s 1.995s p=0.000 n=20
mui-docs - native
Errors 11,405 11,405 ~ ~ ~ p=1.000 n=20
Symbols 3,784,019 3,713,239 -70,780 (- 1.87%) ~ ~ p=0.000 n=20
Types 1,355,974 1,262,950 🟩-93,024 (- 6.86%) ~ ~ p=0.000 n=20
Memory Used 1,769,289k (± 0.08%) 1,910,697k (± 0.07%) 🔻+141,408k (+ 7.99%) 1,903,194k 1,914,087k p=0.000 n=20
Memory Allocs 25,737,944 (± 0.08%) 25,508,701 (± 0.10%) -229,243 (- 0.89%) 25,424,785 25,635,372 p=0.000 n=20
Config Time 0.008s 0.008s (± 1.30%) ~ 0.008s 0.009s p=1.000 n=20
Parse Time 0.282s (± 2.57%) 0.281s (± 2.12%) ~ 0.266s 0.311s p=0.733 n=20
Bind Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Check Time 2.947s (± 0.69%) 3.108s (± 0.79%) 🔻+0.161s (+ 5.45%) 3.059s 3.300s p=0.000 n=20
Emit Time 0.239s (± 1.29%) 0.242s (± 1.49%) ~ 0.232s 0.260s p=0.147 n=20
Total Time 3.960s (± 0.56%) 4.121s (± 0.67%) 🔻+0.161s (+ 4.06%) 4.057s 4.319s p=0.000 n=20
sentry - native
Errors 2 2 ~ ~ ~ p=1.000 n=20
Symbols 4,793,245 4,693,680 -99,565 (- 2.08%) ~ ~ p=0.000 n=20
Types 2,606,905 2,496,397 🟩-110,508 (- 4.24%) ~ ~ p=0.000 n=20
Memory Used 2,846,388k (± 0.04%) 2,984,965k (± 0.03%) 🔻+138,577k (+ 4.87%) 2,982,330k 2,991,104k p=0.000 n=20
Memory Allocs 75,267,408 (± 0.48%) 75,544,825 (± 0.43%) +277,417 (+ 0.37%) 74,959,977 78,022,569 p=0.009 n=20
Config Time 0.025s (± 1.35%) 0.025s (± 1.48%) ~ 0.024s 0.026s p=0.502 n=20
Parse Time 0.484s (± 6.21%) 0.465s (± 3.53%) ~ 0.411s 0.555s p=0.533 n=20
Bind Time 0.158s (±12.69%) 0.148s (±10.66%) ~ 0.118s 0.228s p=0.653 n=20
Check Time 6.560s (± 0.84%) 7.073s (± 0.97%) 🔻+0.513s (+ 7.82%) 6.872s 7.390s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 7.278s (± 0.90%) 7.760s (± 0.89%) 🔻+0.482s (+ 6.62%) 7.580s 8.109s p=0.000 n=20
social-app - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,883,074 1,883,995 +921 (+ 0.05%) ~ ~ p=0.000 n=20
Types 1,158,168 1,148,842 -9,326 (- 0.81%) ~ ~ p=0.000 n=20
Memory Used 966,930k (± 0.02%) 1,012,042k (± 0.01%) 🔻+45,113k (+ 4.67%) 1,011,607k 1,012,445k p=0.000 n=20
Memory Allocs 13,492,108 (± 0.15%) 13,795,368 (± 0.12%) +303,260 (+ 2.25%) 13,752,233 13,858,849 p=0.000 n=20
Config Time 0.007s 0.007s (± 1.48%) ~ 0.007s 0.008s p=1.000 n=20
Parse Time 0.150s (± 2.06%) 0.153s (± 2.83%) ~ 0.139s 0.174s p=0.343 n=20
Bind Time 0.043s (± 8.79%) 0.042s (±10.17%) ~ 0.036s 0.066s p=0.995 n=20
Check Time 1.391s (± 1.00%) 1.578s (± 1.25%) 🔻+0.187s (+13.41%) 1.547s 1.749s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.610s (± 0.77%) 1.798s (± 1.05%) 🔻+0.188s (+11.66%) 1.758s 1.954s p=0.000 n=20
strada-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,184,972 1,186,601 +1,629 (+ 0.14%) ~ ~ p=0.000 n=20
Types 438,959 437,226 -1,733 (- 0.39%) ~ ~ p=0.000 n=20
Memory Used 1,170,629k (± 0.29%) 1,181,393k (± 0.30%) +10,764k (+ 0.92%) 1,166,273k 1,202,215k p=0.000 n=20
Memory Allocs 47,548,831 (± 0.12%) 49,016,550 (± 0.09%) +1,467,719 (+ 3.09%) 48,867,549 49,204,863 p=0.000 n=20
Config Time 0.002s (±15.36%) 0.002s (±22.85%) ~ 0.000s 0.003s p=1.000 n=20
Parse Time 0.138s (± 1.56%) 0.140s (± 2.05%) ~ 0.130s 0.156s p=0.542 n=20
Bind Time 0.000s (±208.60%) 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.800s (± 0.63%) 0.870s (± 0.45%) 🔻+0.070s (+ 8.70%) 0.854s 0.889s p=0.000 n=20
Emit Time 0.140s (± 1.64%) 0.139s (± 1.69%) ~ 0.134s 0.156s p=0.226 n=20
Total Time 9.284s (± 0.46%) 9.870s (± 0.43%) 🔻+0.586s (+ 6.31%) 9.771s 10.035s p=0.000 n=20
strada-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 263,511 263,733 +222 (+ 0.08%) ~ ~ p=0.000 n=20
Types 196,116 195,818 -298 (- 0.15%) ~ ~ p=0.000 n=20
Memory Used 223,535k (± 0.02%) 230,455k (± 0.03%) +6,920k (+ 3.10%) 230,135k 230,640k p=0.000 n=20
Memory Allocs 2,389,691 (± 0.01%) 2,497,315 (± 0.02%) 🔻+107,625 (+ 4.50%) 2,495,875 2,499,365 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.050s (± 3.71%) 0.051s (± 2.57%) ~ 0.046s 0.056s p=0.161 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.381s (± 0.93%) 0.416s (± 0.98%) 🔻+0.035s (+ 9.27%) 0.404s 0.437s p=0.000 n=20
Emit Time 0.048s (± 5.64%) 0.054s (± 4.39%) 🔻+0.006s (+13.36%) 0.042s 0.063s p=0.003 n=20
Total Time 0.505s (± 0.93%) 0.550s (± 0.93%) 🔻+0.045s (+ 8.90%) 0.525s 0.576s p=0.000 n=20
t3code-server - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 4,350,661 4,275,656 -75,005 (- 1.72%) ~ ~ p=0.000 n=20
Types 3,040,644 3,011,403 -29,241 (- 0.96%) ~ ~ p=0.000 n=20
Memory Used 2,417,888k (± 0.04%) 2,543,920k (± 0.03%) 🔻+126,032k (+ 5.21%) 2,541,436k 2,547,953k p=0.000 n=20
Memory Allocs 37,180,852 (± 0.10%) 40,063,160 (± 0.07%) 🔻+2,882,308 (+ 7.75%) 39,971,629 40,177,112 p=0.000 n=20
Config Time 0.003s (± 3.54%) 0.003s (± 7.54%) ~ 0.002s 0.003s p=0.182 n=20
Parse Time 0.248s (± 1.53%) 0.255s (± 3.03%) ~ 0.218s 0.289s p=0.087 n=20
Bind Time 0.085s (± 9.69%) 0.081s (±10.15%) ~ 0.072s 0.132s p=0.363 n=20
Check Time 5.769s (± 0.37%) 6.590s (± 0.56%) 🔻+0.822s (+14.25%) 6.462s 6.756s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 6.117s (± 0.36%) 6.939s (± 0.55%) 🔻+0.823s (+13.45%) 6.807s 7.091s p=0.000 n=20
tanstack-router - native
Errors 1 1 ~ ~ ~ p=1.000 n=20
Symbols 571,756 566,635 -5,121 (- 0.90%) ~ ~ p=0.000 n=20
Types 397,689 388,905 -8,784 (- 2.21%) ~ ~ p=0.000 n=20
Memory Used 326,482k (± 0.02%) 342,986k (± 0.01%) 🔻+16,503k (+ 5.05%) 342,803k 343,237k p=0.000 n=20
Memory Allocs 4,333,452 (± 0.19%) 4,545,914 (± 0.22%) 🔻+212,462 (+ 4.90%) 4,523,627 4,599,950 p=0.000 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.040s (± 4.30%) 0.040s (± 5.09%) ~ 0.034s 0.051s p=0.762 n=20
Bind Time 0.014s (±12.50%) 0.012s (± 6.92%) 🟩-0.003s (-18.69%) 0.011s 0.018s p=0.014 n=20
Check Time 0.513s (± 0.79%) 0.580s (± 0.78%) 🔻+0.067s (+13.10%) 0.565s 0.602s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.584s (± 0.97%) 0.650s (± 0.86%) 🔻+0.066s (+11.31%) 0.631s 0.681s p=0.000 n=20
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=20
Symbols 231,616 231,759 +143 (+ 0.06%) ~ ~ p=0.000 n=20
Types 181,195 181,047 -148 (- 0.08%) ~ ~ p=0.000 n=20
Memory Used 192,974k (± 0.02%) 198,440k (± 0.02%) +5,466k (+ 2.83%) 198,326k 198,555k p=0.000 n=20
Memory Allocs 1,310,034 (± 0.01%) 1,397,371 (± 0.02%) 🔻+87,338 (+ 6.67%) 1,396,512 1,398,322 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.041s (± 3.09%) 0.041s (± 3.45%) ~ 0.036s 0.049s p=1.000 n=20
Bind Time 0.021s (± 4.51%) 0.020s (± 5.12%) ~ 0.016s 0.024s p=0.792 n=20
Check Time 0.295s (± 1.02%) 0.326s (± 1.27%) 🔻+0.031s (+10.36%) 0.310s 0.343s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.364s (± 0.86%) 0.394s (± 0.94%) 🔻+0.030s (+ 8.35%) 0.383s 0.407s p=0.000 n=20
vscode - native
Errors 11 11 ~ ~ ~ p=1.000 n=20
Symbols 7,563,659 7,324,552 🟩-239,107 (- 3.16%) ~ ~ p=0.000 n=20
Types 4,408,914 4,166,398 🟩-242,516 (- 5.50%) ~ ~ p=0.000 n=20
Memory Used 5,227,175k (± 0.02%) 5,314,280k (± 0.01%) +87,105k (+ 1.67%) 5,311,440k 5,316,190k p=0.000 n=20
Memory Allocs 57,320,945 (± 0.02%) 61,181,545 (± 0.02%) 🔻+3,860,600 (+ 6.74%) 61,163,144 61,253,877 p=0.000 n=20
Config Time 0.034s (± 1.39%) 0.034s (± 1.25%) ~ 0.033s 0.035s p=0.217 n=20
Parse Time 0.883s (± 1.92%) 0.887s (± 1.40%) ~ 0.836s 0.943s p=0.693 n=20
Bind Time 0.317s (±10.03%) 0.298s (± 1.71%) ~ 0.284s 0.326s p=0.213 n=20
Check Time 7.229s (± 0.94%) 7.961s (± 0.72%) 🔻+0.732s (+10.12%) 7.848s 8.303s p=0.000 n=20
Emit Time 2.022s (± 7.54%) 2.103s (± 5.93%) +0.080s (+ 3.97%) 1.954s 2.827s p=0.004 n=20
Total Time 10.545s (± 1.37%) 11.340s (± 1.19%) 🔻+0.795s (+ 7.54%) 11.082s 12.138s p=0.000 n=20
webpack - native
Errors 595 601 +6 (+ 1.01%) ~ ~ p=0.000 n=20
Symbols 861,433 861,788 +355 (+ 0.04%) ~ ~ p=0.000 n=20
Types 595,020 593,458 -1,562 (- 0.26%) ~ ~ p=0.000 n=20
Memory Used 632,862k (± 0.02%) 666,983k (± 0.01%) 🔻+34,121k (+ 5.39%) 666,571k 667,330k p=0.000 n=20
Memory Allocs 5,885,837 (± 0.05%) 6,472,281 (± 0.04%) 🔻+586,444 (+ 9.96%) 6,464,935 6,484,476 p=0.000 n=20
Config Time 0.004s 0.004s ~ ~ ~ p=1.000 n=20
Parse Time 0.121s (± 2.89%) 0.123s (± 1.93%) ~ 0.115s 0.131s p=0.198 n=20
Bind Time 0.039s (± 9.77%) 0.041s (±11.91%) ~ 0.033s 0.064s p=0.973 n=20
Check Time 0.983s (± 0.54%) 1.127s (± 0.37%) 🔻+0.144s (+14.64%) 1.113s 1.141s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.170s (± 0.42%) 1.317s (± 0.57%) 🔻+0.147s (+12.55%) 1.295s 1.349s p=0.000 n=20
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 640,490 659,984 +19,494 (+ 3.04%) ~ ~ p=0.000 n=20
Types 387,984 372,710 🟩-15,274 (- 3.94%) ~ ~ p=0.000 n=20
Memory Used 350,143k (± 0.04%) 370,185k (± 0.02%) 🔻+20,043k (+ 5.72%) 369,925k 370,682k p=0.000 n=20
Memory Allocs 3,970,556 (± 0.07%) 4,510,639 (± 0.10%) 🔻+540,083 (+13.60%) 4,495,377 4,533,864 p=0.000 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.059s (± 3.18%) 0.059s (± 1.43%) ~ 0.055s 0.062s p=0.326 n=20
Bind Time 0.019s (± 9.09%) 0.020s (±11.42%) ~ 0.016s 0.032s p=0.903 n=20
Check Time 0.382s (± 0.89%) 0.447s (± 1.19%) 🔻+0.065s (+17.12%) 0.433s 0.468s p=0.000 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.466s (± 0.80%) 0.531s (± 1.08%) 🔻+0.065s (+14.02%) 0.512s 0.550s p=0.000 n=20
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • arktype - native
  • class-transformer - native
  • effect - native
  • mui-docs - native
  • sentry - native
  • social-app - native
  • strada-build-src - native
  • strada-compiler - native
  • t3code-server - native
  • tanstack-router - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 20
Baseline baseline 20

Developer Information:

Download Benchmarks

@jakebailey

Copy link
Copy Markdown
Member Author

Now we're talking

@typescript-automation

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey) Here are the results of running the top 400 repos with tsc comparing baseline and pr:

Something interesting changed - please have a look.

Details

cheaper-inference/OmniRoute

5 of 11 projects failed to build with the old tsc and were ignored

open-sse/tsconfig.json

  • error TS2322: Type 'Promise<ImageResult | MagnificImageResult | { success: boolean; data: { created: any; data: any; }; } | { success: boolean; status: number; error: unknown; } | { data?: undefined; success: boolean; status: number; error: any; }>' is not assignable to type 'Promise<ImageResult>'.

nexu-io/open-design

23 of 53 projects failed to build with the old tsc and were ignored

apps/web/tsconfig.build.json

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant