Cosmos: Complex properties Query #37577

JoasE · 2026-01-28T12:01:47Z

Adds Cosmos Db query pipeline support for complex properties
Part of: #31253
Replace IEntityType and IProperty with ITypeBase and IPropertyBase in appropriate places. Along with a couple of class and variable renames
Adds ComplexProperty binding for StructuralTypeProjectionExpression
Do not translate distinct in TranslateDistinct with projections of child documents, related: #34067
Translate Nullable<>.HasValue to != null and Nullable<>.Value to direct property access
Move structural equality to partial class
Translate complex equality by direct comparison
Use CollectionResultExpression for complex property collections
Add assosiations, query and adhoc tests
list.Contains(complexType) not supported as per: 36468
TypeIs not supported, as per: 31250

I've read the guidelines for contributing and seen the walkthrough
I've posted a comment on an issue with a detailed description of how I am planning to contribute and got approval from a member of the team
The code builds and tests pass locally (also verified by our automated build checks)
Commit messages follow this format:

        Summary of the changes
        - Detail 1
        - Detail 2

        Fixes #bugnumber

Tests for the changes have been added (for bug fixes / features)
Code follows the same patterns and style as existing code in this repo

… pipeline

…erator for cosmos

…complex-properties-query

Copilot

Pull request overview

Adds Cosmos DB query pipeline support for complex/structural types (complex properties), expanding translation capabilities and adding Cosmos-specific test coverage to validate expected SQL and failure behaviors.

Changes:

Generalizes Cosmos projection/binding from entity-only to structural types via StructuralTypeProjectionExpression, adding complex-property binding support.
Introduces structural equality translation for complex types (including parameter extraction support) and adds a Distinct translation guard when client projection is involved.
Adds/updates Cosmos functional tests for complex type queries and complex-property association scenarios (projection, equality, set operations, collections, primitive collections), plus a few ad-hoc helpers/fixtures.

Reviewed changes

Copilot reviewed 27 out of 27 changed files in this pull request and generated 6 comments.

Show a summary per file

File	Description
test/EFCore.Specification.Tests/Query/AdHocComplexTypeQueryTestBase.cs	Adjusts ad-hoc complex-type test seeding and exposes context for provider-specific derivations.
test/EFCore.Cosmos.FunctionalTests/Query/NorthwindAggregateOperatorsQueryCosmosTest.cs	Updates Distinct-related baselines and replaces CI skip attribute.
test/EFCore.Cosmos.FunctionalTests/Query/ComplexTypeQueryCosmosTest.cs	New Cosmos-specific complex type query test baselines and translation-failure expectations.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/OwnedNavigations/OwnedNavigationsProjectionCosmosTest.cs	Adds a Distinct-over-owned-associate translation-failure test.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesStructuralEqualityCosmosTest.cs	New Cosmos tests validating complex/associate structural equality translation behavior.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesSetOperationsCosmosTest.cs	New Cosmos tests for set operations over complex-property association scenarios.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesProjectionCosmosTest.cs	Enables previously-skipped projection tests and updates baselines accordingly.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesPrimitiveCollectionCosmosTest.cs	New Cosmos tests for primitive-collection operations under complex properties.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesMiscellaneousCosmosTest.cs	New Cosmos tests for miscellaneous complex-property predicate/value-type translations.
test/EFCore.Cosmos.FunctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesCollectionCosmosTest.cs	New Cosmos tests for complex-property collection operators (Count/Where/Distinct/Index/etc.).
test/EFCore.Cosmos.FunctionalTests/Query/AdHocCosmosTestHelpers.cs	Adds a helper to configure deterministic int key generation for Cosmos ad-hoc tests.
test/EFCore.Cosmos.FunctionalTests/Query/AdHocComplexTypeQueryCosmosTest.cs	New Cosmos ad-hoc complex-type test with Cosmos SQL baselines and Cosmos-specific initialization.
test/EFCore.Cosmos.FunctionalTests/CosmosComplexTypesTrackingTest.cs	Changes one tracking test to skip sync rather than silently completing, and runs async path.
src/EFCore.Cosmos/Query/Internal/SqlExpressionVisitor.cs	Updates visitor dispatch to the new structural projection expression type.
src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs	Renames/generalizes entity projection to structural projection and adds complex-property binding.
src/EFCore.Cosmos/Query/Internal/Expressions/SelectExpression.cs	Tracks whether client projection is used (for later translation decisions like Distinct).
src/EFCore.Cosmos/Query/Internal/Expressions/ObjectReferenceExpression.cs	Generalizes object references from `IEntityType` to `ITypeBase`.
src/EFCore.Cosmos/Query/Internal/Expressions/ObjectArrayAccessExpression.cs	Extends array-access expressions to support complex-property collections.
src/EFCore.Cosmos/Query/Internal/Expressions/ObjectAccessExpression.cs	Extends object-access expressions to support complex properties and structural types.
src/EFCore.Cosmos/Query/Internal/CosmosSqlTranslatingExpressionVisitor.cs	Refactors to partial class and routes equality rewriting to structural-type-aware logic.
src/EFCore.Cosmos/Query/Internal/CosmosSqlTranslatingExpressionVisitor.StructuralEquality.cs	New structural equality implementation for entity/complex comparisons and parameter extraction.
src/EFCore.Cosmos/Query/Internal/CosmosShapedQueryCompilingExpressionVisitor.CosmosProjectionBindingRemovingExpressionVisitorBase.cs	Updates projection binding removal to work with structural projections and new access expressions.
src/EFCore.Cosmos/Query/Internal/CosmosQueryableMethodTranslatingExpressionVisitor.cs	Enables complex-property collection translation paths and prevents Distinct in client-projection scenarios.
src/EFCore.Cosmos/Query/Internal/CosmosQuerySqlGenerator.cs	Updates SQL generator to use the new structural projection expression.
src/EFCore.Cosmos/Query/Internal/CosmosProjectionBindingExpressionVisitor.cs	Marks selects that fall back to client projection, impacting later translation decisions.
src/EFCore.Cosmos/Query/Internal/CosmosAliasManager.cs	Updates alias rewriting for structural object references.
src/EFCore.Cosmos/Extensions/Internal/CosmosShapedQueryExpressionExtensions.cs	Updates projection extraction logic for the renamed structural projection expression.

Comments suppressed due to low confidence (3)

src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs:186

BindComplexProperty throws UnableToBindMemberToEntityProjection with memberType set to "navigation". This looks like a copy/paste error and will produce a misleading error message for complex properties; use a distinct memberType (e.g. "complexProperty") like the relational structural projection does.
src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs:287
UpdateEntityType should only be callable when StructuralType is an IEntityType. As written, it uses derivedType.GetAllBaseTypes().Contains(StructuralType) which mixes ITypeBase with the entity-type hierarchy and can misbehave (or fail to compile, depending on the GetAllBaseTypes() return type). Align this with the relational implementation by first asserting/casting StructuralType to IEntityType and then performing the base-type check against that entity type.
src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs:337
ToString() still returns the prefix "EntityProjectionExpression" even though the type was renamed to StructuralTypeProjectionExpression, which makes debugging/logging confusing. Update the string to reflect the new type name.

test/EFCore.Cosmos.FunctionalTests/Query/AdHocCosmosTestHelpers.cs

test/EFCore.Cosmos.FunctionalTests/Query/ComplexTypeQueryCosmosTest.cs

Copilot · 2026-02-09T10:14:13Z

...hapedQueryCompilingExpressionVisitor.CosmosProjectionBindingRemovingExpressionVisitorBase.cs

                    var accessExpression = objectArrayAccess.InnerProjection.Object;
                    _projectionBindings[accessExpression] = jObjectParameter;
                    _ownerMappings[accessExpression] =
-                        (objectArrayAccess.Navigation.DeclaringEntityType, objectArrayAccess.Object);
+                        ((IEntityType)objectArrayAccess.PropertyBase.DeclaringType, objectArrayAccess.Object);
                    _ordinalParameterBindings[accessExpression] = Add(


objectArrayAccess.PropertyBase can now be an IComplexProperty (complex collection). The cast to (IEntityType)objectArrayAccess.PropertyBase.DeclaringType will throw if the declaring type is a complex type. If _ownerMappings is only needed for owned navigations, guard this assignment to the navigation case (or change the mapping to store ITypeBase).

It can't be as complex types are always handled by CosmosShapedQueryCompilingExpressionVisitor.AddStructuralTypeInitialization Should I add a comment here to clarify?

test/EFCore.Cosmos.FunctionalTests/Query/AdHocCosmosTestHelpers.cs

Copilot · 2026-02-09T10:14:13Z

...hapedQueryCompilingExpressionVisitor.CosmosProjectionBindingRemovingExpressionVisitorBase.cs

                                            accessExpression = objectAccessExpression.Object;
                                            storeNames.Add(objectAccessExpression.PropertyName);
                                            _ownerMappings[objectAccessExpression]
-                                                = (objectAccessExpression.Navigation.DeclaringEntityType, accessExpression);
+                                                = ((IEntityType)objectAccessExpression.PropertyBase.DeclaringType, accessExpression);
                                        }


_ownerMappings assumes the access chain represents owned navigations and casts objectAccessExpression.PropertyBase.DeclaringType to IEntityType. With the new PropertyBase support for complex properties, ObjectAccessExpression can now represent an IComplexProperty, whose DeclaringType may be an IComplexType—this cast will throw at runtime. Consider only populating _ownerMappings when PropertyBase is an INavigation (owned entity navigation), and skip/handle complex-property accesses separately.

It can't be as complex types are always handled by CosmosShapedQueryCompilingExpressionVisitor.AddStructuralTypeInitialization Should I add a comment here to clarify?

src/EFCore.Cosmos/Query/Internal/CosmosSqlTranslatingExpressionVisitor.StructuralEquality.cs

roji · 2026-02-09T10:16:12Z

@JoasE thanks for this. I'll hold off reviewing until you resolve the Copilot comments above, just to save on the effort (we can do this in future PRs as well). Feel free to ping me once everything's ready for a human review.

Copilot

Pull request overview

Copilot reviewed 27 out of 27 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (3)

src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs:287

UpdateEntityType calls derivedType.GetAllBaseTypes().Contains(StructuralType), but StructuralType is ITypeBase while GetAllBaseTypes() yields IEntityType; this doesn’t type-check (and even conceptually UpdateEntityType should only operate when StructuralType is an IEntityType). Cast/guard StructuralType to IEntityType (or change the stored type) before calling Contains, and fail fast if StructuralType isn’t an entity type.
src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs:186
BindComplexProperty throws UnableToBindMemberToEntityProjection with member kind "navigation"; that will produce a misleading error message for complex properties. Pass an appropriate member kind (e.g. "complex property") so diagnostics are accurate.
src/EFCore.Cosmos/Query/Internal/Expressions/StructuralTypeProjectionExpression.cs:337
ToString() still returns "EntityProjectionExpression" even though the type was renamed. Update the string to reflect StructuralTypeProjectionExpression to avoid confusion when debugging/printing expressions.

src/EFCore.Cosmos/Query/Internal/CosmosSqlTranslatingExpressionVisitor.StructuralEquality.cs

...unctionalTests/Query/Associations/ComplexProperties/ComplexPropertiesCollectionCosmosTest.cs

Copilot

Pull request overview

Copilot reviewed 32 out of 32 changed files in this pull request and generated 3 comments.

src/EFCore.Cosmos/Query/Internal/Expressions/CollectionResultExpression.cs

src/EFCore.Cosmos/Query/Internal/CosmosQueryableMethodTranslatingExpressionVisitor.cs

Copilot

Pull request overview

Copilot reviewed 32 out of 32 changed files in this pull request and generated 3 comments.

test/EFCore.Cosmos.FunctionalTests/Query/AdHocCosmosTestHelpers.cs

src/EFCore.Cosmos/Query/Internal/Expressions/CollectionResultExpression.cs

src/EFCore/Update/PropertyExtensions.cs

Copilot

Pull request overview

Copilot reviewed 32 out of 32 changed files in this pull request and generated 4 comments.

test/EFCore.Cosmos.FunctionalTests/Query/ComplexTypeQueryCosmosTest.cs

src/EFCore/Update/PropertyExtensions.cs

src/EFCore.Cosmos/Query/Internal/CosmosSerializationUtilities.cs

Copilot

Pull request overview

Copilot reviewed 32 out of 32 changed files in this pull request and generated no new comments.

JoasE added 6 commits January 28, 2026 09:28

WIP: Add some tests

d352388

Copy over files: Use StructuralType where needed in query translation…

6490d7b

… pipeline

Add some more tests

d9d91d2

Rewrite some baselines

003383d

Fix async tests

7f7b564

WIP: distinct, contains and null

1b4b5cd

This comment was marked as resolved.

Sign in to view

JoasE mentioned this pull request Jan 30, 2026

Question on Cosmos DB database provider owned object querying null #24087

Closed

JoasE added 9 commits January 31, 2026 16:19

Fix test do not explicitly set int ids in base test but use value gen…

bbc3477

…erator for cosmos

Improve object retrieval for null comparison

de6328f

Distinct detection

607a921

WIP some docs for question

0457143

WIP: Match code structure of relational where possible

5ac80e0

Merge branch 'main' of https://github.com/dotnet/efcore into feature/…

a682368

…complex-properties-query

Cleanup

753f31e

Rename TypeBase to StructuralType

88c84b6

Cleanup and add todo

19c1de1

AndriySvyryd added the community-contribution label Feb 4, 2026

JoasE added 3 commits February 9, 2026 10:42

Merge branch 'main' of https://github.com/dotnet/efcore into feature/…

3396b9a

…complex-properties-query

Implement test

a5a8bd4

Remove old unused class

3b21620

JoasE force-pushed the feature/complex-properties-query branch from c4dea47 to 3b21620 Compare February 9, 2026 09:47

JoasE marked this pull request as ready for review February 9, 2026 10:03

JoasE requested a review from a team as a code owner February 9, 2026 10:03

Copilot AI review requested due to automatic review settings February 9, 2026 10:03

Copilot started reviewing on behalf of JoasE February 9, 2026 10:04 View session

Remove skip on fixed tests

7127586

Copilot AI reviewed Feb 9, 2026

View reviewed changes

Rename test class

82e9b15

JoasE added 2 commits February 9, 2026 12:24

Fix null check structural comparison

dd4b3f0

Rename field

8126941

Copilot AI review requested due to automatic review settings February 9, 2026 11:31

Copilot started reviewing on behalf of JoasE February 9, 2026 11:32 View session

This comment was marked as outdated.

Sign in to view

Copilot AI reviewed Feb 9, 2026

View reviewed changes

JoasE marked this pull request as draft February 9, 2026 13:01

JoasE added 2 commits February 10, 2026 13:53

WIP: Use direct comparison

2a96a9b

Use CollectionResultExpression for complex collections

dbd1d17

JoasE requested a review from Copilot February 10, 2026 12:56

Copilot started reviewing on behalf of JoasE February 10, 2026 12:57 View session

Regenerate test

ee66c0a

Copilot AI reviewed Feb 10, 2026

View reviewed changes

Add test and fix

c258b9c

JoasE mentioned this pull request Feb 10, 2026

Cosmos: Implement proper entity equality and contains logic for owned (and complex) types #34027

Open

JoasE requested a review from Copilot February 10, 2026 14:19

Copilot started reviewing on behalf of JoasE February 10, 2026 14:19 View session

Copilot AI reviewed Feb 10, 2026

View reviewed changes

test/EFCore.Cosmos.FunctionalTests/Query/AdHocCosmosTestHelpers.cs Show resolved Hide resolved

src/EFCore.Cosmos/Query/Internal/Expressions/CollectionResultExpression.cs Outdated Show resolved Hide resolved

src/EFCore/Update/PropertyExtensions.cs Show resolved Hide resolved

JoasE added 2 commits February 10, 2026 15:33

Add docs

d248623

Use property clr type

b3d68eb

JoasE requested a review from Copilot February 10, 2026 14:37

Copilot started reviewing on behalf of JoasE February 10, 2026 14:38 View session

Copilot AI reviewed Feb 10, 2026

View reviewed changes

JoasE added 2 commits February 10, 2026 15:50

Remove bom

3a19515

Make internal

ddcba7e

JoasE requested a review from Copilot February 10, 2026 14:54

Copilot started reviewing on behalf of JoasE February 10, 2026 14:55 View session

Copilot AI reviewed Feb 10, 2026

View reviewed changes

JoasE marked this pull request as ready for review February 11, 2026 09:54

JoasE requested a review from roji February 11, 2026 09:54

Cosmos: Complex properties Query #37577

Are you sure you want to change the base?

Cosmos: Complex properties Query #37577

Uh oh!

Conversation

JoasE commented Jan 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Copilot AI Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

JoasE Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Copilot AI Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

JoasE Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

roji commented Feb 9, 2026

Uh oh!

This comment was marked as outdated.

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

JoasE commented Jan 28, 2026 •

edited

Loading