Detect local arguments and functions used in a function by samwaseda · Pull Request #164 · pyiron/flowrep

samwaseda · 2026-02-26T08:36:43Z

Following the effort in #155, I started trying to parse variables as well. Edits will follow....

github-actions · 2026-02-26T08:36:54Z

👈 Launch a binder notebook on branch pyiron/flowrep/args

samwaseda · 2026-02-26T08:42:22Z

@liamhuber I started looking into the possibility of including variables as well. Frankly I'm also not really convinced but I still would like to explore the possibility

codecov · 2026-02-26T08:43:22Z

Codecov Report

❌ Patch coverage is 89.23077% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 97.65%. Comparing base (ef7ec85) to head (1e893de).

Files with missing lines	Patch %	Lines
flowrep/models/parsers/dependency_parser.py	89.23%	7 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #164      +/-   ##
==========================================
- Coverage   97.97%   97.65%   -0.32%     
==========================================
  Files          34       34              
  Lines        2268     2305      +37     
==========================================
+ Hits         2222     2251      +29     
- Misses         46       54       +8

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

samwaseda · 2026-02-26T13:54:40Z

I just had a discussion with @XzzX and we think we can keep the current implementation is maybe not quite as useless as I had imagined, because with this implementation it is now possible to throw an error as soon as an external variable is used.

liamhuber · 2026-02-26T19:19:41Z

because with this implementation it is now possible to throw an error as soon as an external variable is used.

Failing cleanly is infinitely better than looking like everything is well-provenanced when it isn't. However, I still think that restricting "ok locally defined stuff" to mean "don't use any symbols outside your function definition" is going to turn out to be a more annoying, more restrictive, more-work solution than telling people "you'll have to use well-versioned code to contribute to the KG". As an intermediate step towards catching and leveraging these external symbols, this still seems like solid progress though.

Copilot

Pull request overview

This PR updates dependency_parser to infer function dependencies by identifying undefined names in a function’s AST (including from type hints) and resolving those names from the function’s scope, recursively exploring unversioned objects.

Changes:

Replaced call-graph-based dependency crawling with undefined-variable detection and resolution.
Added UndefinedVariableVisitor and find_undefined_variables helpers to drive dependency discovery.
Reworked test_dependency_parser to focus on the new undefined-variable behavior and mocked resolution.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 7 comments.

File	Description
`flowrep/models/parsers/dependency_parser.py`	Introduces undefined-name visitor + new dependency collection approach based on scope resolution and version availability.
`tests/unit/models/parsers/test_dependency_parser.py`	Replaces prior call-dependency tests with new tests for splitting, undefined-name detection, and mocked dependency discovery.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

flowrep/models/parsers/dependency_parser.py

tests/unit/models/parsers/test_dependency_parser.py

flowrep/models/parsers/dependency_parser.py

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

This PR modifies the dependency parsing logic to detect names used-but-not-defined in a function’s source (e.g., globals/type-hint symbols) and resolve them to objects for version tracking, as part of the ongoing dependency-crawling work from #155.

Changes:

Added an AST visitor (UndefinedVariableVisitor) plus find_undefined_variables to extract undefined symbols from source code.
Reworked get_call_dependencies to resolve those symbols via object_scope and optionally recurse for unversioned objects.
Replaced the prior call-graph oriented unit tests with new tests focused on undefined-variable discovery and resolution.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.

File	Description
`flowrep/models/parsers/dependency_parser.py`	Adds undefined-variable detection and updates dependency collection logic to resolve those symbols to objects.
`tests/unit/models/parsers/test_dependency_parser.py`	Rewrites tests to cover the new undefined-variable based behavior and mocked resolution paths.

Comments suppressed due to low confidence (1)

tests/unit/models/parsers/test_dependency_parser.py:102

test_type_hints references np but the module isn't imported/defined anywhere in this test module, so defining test_function will raise NameError (or later get_call_dependencies will fail resolving it). Also, CI envs here don't include optional deps like NumPy, so importing NumPy in the test would be brittle. Define a small module-level dummy np (with an .array attribute) or use a stdlib object instead so the test is self-contained and doesn't add a new dependency.


if __name__ == "__main__":
    unittest.main()

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

flowrep/models/parsers/dependency_parser.py

+    def visit_Name(self, node):
+        if isinstance(node.ctx, ast.Load):  # Variable is being used
+            self.used_vars.add(node.id)
+        elif isinstance(node.ctx, ast.Store):  # Variable is being defined
+            self.defined_vars.add(node.id)
+
+    def visit_FunctionDef(self, node):
+        # Add the function name itself to defined variables
+        self.defined_vars.add(node.name)
+        # Add function arguments to defined variables
+        for arg in node.args.args:
+            self.defined_vars.add(arg.arg)
+        self.generic_visit(node)
+
+    def visit_AsyncFunctionDef(self, node):
+        # Add the async function name itself to defined variables
+        self.defined_vars.add(node.name)
+        # Add async function arguments to defined variables
+        for arg in node.args.args:
+            self.defined_vars.add(arg.arg)


flowrep/models/parsers/dependency_parser.py

+def get_call_dependencies(
+    func_or_var: Callable | object,
+    version_scraping: versions.VersionScrapingMap | None = None,
+    _call_dependencies: CallDependencies | None = None,
+    _visited: set[str] | None = None,
+) -> CallDependencies:
+
+    call_dependencies: CallDependencies = _call_dependencies or {}
+    visited: set[str] = _visited or set()
+
+    func_fqn = versions.VersionInfo.of(func_or_var).fully_qualified_name
+    if func_fqn in visited:
+        return call_dependencies
+    visited.add(func_fqn)
+
+    # Find variables that are used but not defined
+    scope = object_scope.get_scope(func_or_var)
+    for item in find_undefined_variables(func_or_var):
+        obj = object_scope.resolve_attribute_to_object(item, scope)
+        info = versions.VersionInfo.of(obj, version_scraping=version_scraping)
+        call_dependencies[info] = obj
+
+        if info.version is None:
+            get_call_dependencies(obj, version_scraping, call_dependencies, visited)
+    return call_dependencies


samwaseda · 2026-03-19T18:06:09Z

@copilot Rewrite UndefinedVariableVisitor to forbid local function definitions.

Copilot · 2026-03-19T18:06:17Z

@samwaseda I've opened a new pull request, #190, to work on those changes. Once the pull request is ready, I'll request review from you.

Co-authored-by: samwaseda <37879103+samwaseda@users.noreply.github.com>

Detect local arguments and functions used in a function

samwaseda added 7 commits February 25, 2026 18:32

Current state

cede0a1

Merge branch 'resolve' into args

9386d7e

Refactor items

87604aa

Rename some stuff

995b9ef

Move get_dependencies

f0b255c

safe guard for inline access to members

bb5d7a5

Add tests and black

0862a51

samwaseda changed the base branch from main to crawler February 26, 2026 08:36

samwaseda marked this pull request as draft February 26, 2026 08:37

samwaseda added 2 commits February 26, 2026 09:38

future annotation

c6c0fa1

mypy

c1c7978

samwaseda marked this pull request as ready for review February 26, 2026 13:55

This was referenced Feb 26, 2026

Detect all local functions and imported functions recursively #155

Merged

[refactor] Separate transformation to object from ast parsing #161

Merged

Base automatically changed from crawler to main February 27, 2026 07:20

Merge remote-tracking branch 'origin' into args

a646a44

liamhuber mentioned this pull request Mar 5, 2026

Example of how atomic nodes are not policed #171

Closed

samwaseda and others added 8 commits March 8, 2026 18:39

Merge remote-tracking branch 'origin' into args

690c213

Create find_undefined_variables

740aa51

Merge remote-tracking branch 'origin' into args

ef0169a

Do not distinguish between functions and variables

ea31b27

go recursive only if there is no version

50503f6

black

9e6ee43

Add one more test

ee1c5ce

[dependabot skip] Update env file

e2b19d5

samwaseda mentioned this pull request Mar 18, 2026

How to make sense of module of some non-callable pyiron/pyiron_snippets#86

Open

samwaseda added 2 commits March 18, 2026 11:17

Merge remote-tracking branch 'origin' into args

8e1a845

Resolve conflict

fa1d666

samwaseda changed the title ~~Detect arguments as well~~ Detect local arguments and functions used in a function Mar 18, 2026

samwaseda added 4 commits March 18, 2026 11:26

Align code

923e300

ruff

0663d05

Remove try except and add tests

0f301b7

Merge remote-tracking branch 'origin' into args

09df6fd

samwaseda requested a review from Copilot March 19, 2026 16:01

Copilot AI reviewed Mar 19, 2026

View reviewed changes

samwaseda and others added 4 commits March 19, 2026 17:12

Potential fix for pull request finding

777a558

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Potential fix for pull request finding

56aa4f2

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Potential fix for pull request finding

3de03c5

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Potential fix for pull request finding

dcd510b

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

samwaseda requested a review from Copilot March 19, 2026 17:53

Copilot started reviewing on behalf of samwaseda March 19, 2026 17:53 View session

Remove tests for now

2d48634

Copilot AI reviewed Mar 19, 2026

View reviewed changes

Initial plan

bc0accd

Copilot AI mentioned this pull request Mar 19, 2026

Detect local arguments and functions used in a function #190

Merged

Copilot AI and others added 2 commits March 19, 2026 18:10

Rewrite UndefinedVariableVisitor to forbid local function definitions

dbb1188

Co-authored-by: samwaseda <37879103+samwaseda@users.noreply.github.com>

Merge pull request #190 from pyiron/copilot/sub-pr-164

1e893de

Detect local arguments and functions used in a function

Conversation

samwaseda commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 26, 2026

Uh oh!

samwaseda commented Feb 26, 2026

Uh oh!

codecov bot commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

samwaseda commented Feb 26, 2026

Uh oh!

liamhuber commented Feb 26, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

samwaseda commented Mar 19, 2026

Uh oh!

Copilot AI commented Mar 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

samwaseda commented Feb 26, 2026 •

edited

Loading

codecov bot commented Feb 26, 2026 •

edited

Loading