Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Roslyn Tokenizer #11086

Merged
merged 44 commits into from
Oct 25, 2024
Merged
Changes from 1 commit
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
46698be
Rename existing C# tokenizer to have a legacy prefix
333fred Jun 20, 2024
b3f0a12
Duplicate existing tokenizer and add a flag to control whether to use…
333fred Jun 20, 2024
14f71e2
Remove roslyn package pinning
333fred Jul 18, 2024
b3f055a
Legacy->Native
333fred Jul 29, 2024
b9c924b
Roslyn Tokenizer Infrastructure (#10676)
333fred Jul 29, 2024
4346076
Merge remote-tracking branch 'upstream/main' into merge-main
333fred Jul 29, 2024
a35513a
Merge main (#10679)
333fred Jul 29, 2024
894a9ba
Remove unused ITokenizer interface, make tokenizers disposable.
333fred Aug 1, 2024
a15d7cc
Remove unneeded common states
333fred Aug 1, 2024
3a8fd07
Allow setting the next tokenizer state after a razor comment body is …
333fred Aug 1, 2024
60ac8d1
Plumb the Roslyn tokenizer through more tests
333fred Aug 1, 2024
73aa717
Nullable enable the tokenizer
333fred Aug 1, 2024
dcef8ed
Add consolidated syntax kinds. Since there aren't consumers that care…
333fred Aug 1, 2024
5749a8e
Give better error messages when syntax tree verification fails.
333fred Aug 1, 2024
2823f64
The big change: use the roslyn tokenizer for tokenizing C#.
333fred Aug 1, 2024
c25ac20
Update SyntaxKinds to the new consolidated kinds in tests.
333fred Aug 1, 2024
34ab111
Increase test coverage of a few scenarios, and bulk up existing tests.
333fred Aug 1, 2024
abd6aba
Skip test for now, give a better exception.
333fred Aug 1, 2024
acf7a60
Name change
333fred Aug 1, 2024
640d377
Better support giving errors on raw string literals, increase test co…
333fred Aug 2, 2024
3155200
PR feedback.
333fred Aug 2, 2024
1a0d57d
Convert to the correct type
333fred Aug 2, 2024
aa24f69
Additional commenting and PR feedback. I've simplified the reset loop…
333fred Aug 6, 2024
5b7e927
More feedback
333fred Aug 9, 2024
91bbfde
Use the roslyn tokenizer (#10702)
333fred Aug 12, 2024
711bda8
Merge remote-tracking branch 'upstream/main' into features/roslyn-tok…
333fred Aug 12, 2024
8bf616a
Merge main to tokenizer branch (#10724)
333fred Aug 12, 2024
fef2d1c
Plumb CSharpParseOptions to the tokenizer (#10733)
333fred Aug 13, 2024
35871e3
Merge remote-tracking branch 'upstream/main' into merge-main
333fred Aug 22, 2024
647126b
Merge main to tokenizer branch (#10781)
333fred Aug 22, 2024
d7d4932
Merge remote-tracking branch 'upstream/main' into features/roslyn-tok…
333fred Sep 10, 2024
0ea44ba
Reimplement IDispoasable in test clases.
333fred Sep 10, 2024
87dafaf
Merge main to tokenizer branch (#10872)
333fred Sep 12, 2024
07b168a
Support directive tokenization (#10979)
333fred Oct 11, 2024
99c61dd
Enable the new tokenizer for tooling tests (#11010)
333fred Oct 15, 2024
2f584c9
Use the code component for correct test output
333fred Oct 21, 2024
7598fbf
Reset isOnlyWhitespaceOnLine in scenario revealed in IDE test
333fred Oct 22, 2024
dfe65f9
Add new tests for switch case (#11063)
333fred Oct 22, 2024
2aac41c
Merge remote-tracking branch 'upstream/main' into merge-main
333fred Oct 23, 2024
7b81af5
One more baseline update
333fred Oct 23, 2024
c724539
Merge main (#11075)
333fred Oct 23, 2024
c20c1cd
Final lexer changes (#11078)
333fred Oct 24, 2024
6169824
Merge remote-tracking branch 'upstream/main' into merge-main
333fred Oct 24, 2024
927d6a9
Merge main to tokenizer branch (#11085)
333fred Oct 24, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'upstream/main' into features/roslyn-tok…
…enizer

* upstream/main: (53 commits)
  Move to central package pinning (#10716)
  Try to fix rename tests
  Unskip rename tests
  I spent 10 minutes looking up cool Mr Freeze catch phrases for this commit message, and I didn't like any of them.
  Clean up CompilationTagHelperResolver
  Clean up all ITagHelperDescriptorProviders a bit (and found a bug!)
  Make ExcludeHidden and IncludeDocumentation init-only properties
  Swap TagHelperDescriptorProviderContext.Create methods for constructors
  Remove TagHelperDescriptorProviderContext.Items property
  Make TargetSymbol a TagHelperDescriptorProviderContext property
  Make Compilation a TagHelperDescriptorProviderContext property
  Merge TagHelperDescriptorProviderContext and DefaultContext
  Don't pass code document and source text around in diagnostics translator, plus some cleanup
  Remove unnecessary parameter, because it can be trivially retrieved
  Find razor document correctly in RemoveDocumentMappingService
  Add extension methods that convert URIs to Roslyn file paths
  Use Uri.LocalPath rather than GetAbsoluteOrUNCPath()
  Move MapToHostDocuementUriAndRangeAsync to extension methods
  Fix small typo in comment
  Remove unused DocumentState method
  ...
  • Loading branch information
333fred committed Aug 12, 2024
commit 711bda8ebb9987720d047b0f1747150ea3c2b1d9

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.