Skip to content

Conversation

@serenity4
Copy link
Collaborator

@serenity4 serenity4 commented Apr 18, 2025

This allows Revise to work with JuliaDebug/CodeTracking.jl#140. Requires JuliaDebug/JuliaInterpreter.jl#680.

This change is breaking, so we may either:

  • Tag a new breaking release.
  • Keep backwards compatibility by supporting a signatures vector that uses the previous sig format.

Copy link
Member

@timholy timholy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great. You'd want to bump the [compat] for CodeTracking to 2.

I think I'd favor the breaking release, but if you see advantages in keeping backwards compatibility then I wouldn't stand in the way.

serenity4 and others added 6 commits April 21, 2025 17:21
@serenity4
Copy link
Collaborator Author

Looks great. You'd want to bump the [compat] for CodeTracking to 2.

CodeTracking is not a direct dependency of LoweredCodeUtils, but since it indirectly is via JuliaInterpreter I'll add it.

We already used `extract_method_table` from JuliaInterpreter, obsoleting the introduction
of `method_table`.
@serenity4 serenity4 force-pushed the support-external-methodtables branch 3 times, most recently from 7a800ae to 9c2c545 Compare April 21, 2025 17:55
@serenity4 serenity4 force-pushed the support-external-methodtables branch from 9c2c545 to 73d89d5 Compare April 21, 2025 18:26
@codecov
Copy link

codecov bot commented Apr 21, 2025

Codecov Report

❌ Patch coverage is 90.90909% with 3 lines in your changes missing coverage. Please review.
✅ Project coverage is 76.90%. Comparing base (550a2a4) to head (154f937).
⚠️ Report is 48 commits behind head on master.

Files with missing lines Patch % Lines
src/signatures.jl 92.00% 2 Missing ⚠️
src/codeedges.jl 87.50% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           master     #125       +/-   ##
===========================================
- Coverage   88.69%   76.90%   -11.80%     
===========================================
  Files           6        6               
  Lines        1442     1524       +82     
===========================================
- Hits         1279     1172      -107     
- Misses        163      352      +189     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@serenity4 serenity4 force-pushed the support-external-methodtables branch from 782bf05 to f8d0560 Compare April 21, 2025 18:31
@serenity4 serenity4 force-pushed the support-external-methodtables branch from f8d0560 to b8520fc Compare April 21, 2025 18:39
@serenity4
Copy link
Collaborator Author

serenity4 commented Apr 24, 2025

The failing test at https://github.com/JuliaDebug/LoweredCodeUtils.jl/actions/runs/14648771143/job/41109358572?pr=125#step:7:112 asserts that a function object depends on its first method definition. I slightly restructured the implementation for method code edge dependencies in 8548679, and naturally expected a function binding to depend on its declaration, but not on the method definition. @aviatesk or @timholy would that be more correct according to you, or is it a regression?

In the code below, the defintion of Main.ModEval.revise538 now depends on $(Expr(:method, :(Main.ModEval.revise538))) only, and not on the actual method definition:

CodeInfo(
    @ /home/serenity4/.julia/dev/LoweredCodeUtils/test/codeedges.jl:339 within `unknown scope`
1%1  = enter #4
    @ /home/serenity4/.julia/dev/LoweredCodeUtils/test/codeedges.jl:340 within `unknown scope`
2global revise538
│         $(Expr(:latestworld))
│         $(Expr(:method, :(Main.ModEval.revise538)))
│         $(Expr(:latestworld))
│         $(Expr(:latestworld))
│   %7  = Main.ModEval.revise538
│   %8  =   dynamic Core.Typeof(%7)
│   %9  = Main.ModEval.Float32
│   %10 =   builtin Core.svec(%8, %9)
│   %11 =   builtin Core.svec()
│   %12 =   builtin Core.svec(%10, %11, $(QuoteNode(:(#= /home/serenity4/.julia/dev/LoweredCodeUtils/test/codeedges.jl:340 =#))))
│         $(Expr(:method, :(Main.ModEval.revise538), :(%12), CodeInfo(
    @ /home/serenity4/.julia/dev/LoweredCodeUtils/test/codeedges.jl:341 within `unknown scope`
1%1 = Main.ModEval.println
│   %2 =   dynamic (%1)("F32")
└──      return %2
)))
│         $(Expr(:latestworld))
│   %15 = Main.ModEval.revise538
└──       $(Expr(:leave, :(%1)))
3return %15
4 ┄       e = $(Expr(:the_exception))
│   @ /home/serenity4/.julia/dev/LoweredCodeUtils/test/codeedges.jl:344 within `unknown scope`%19 = Main.ModEval.println
│   %20 =   dynamic (%19)("caught error")
│         $(Expr(:pop_exception, :(%1)))
└──       return %20
)

julia> lr[13]
false

Nothing in the refactor depends on that so I'm fine removing this change if necessary.

@serenity4
Copy link
Collaborator Author

Any input regarding my comment above? If unsure, I can restore the previous behavior.

@serenity4 serenity4 marked this pull request as ready for review June 10, 2025 13:18
@serenity4 serenity4 force-pushed the support-external-methodtables branch from c5376ba to b985309 Compare June 10, 2025 13:36
@serenity4 serenity4 force-pushed the support-external-methodtables branch from ee3dc4c to 8d8784f Compare June 10, 2025 13:53
@serenity4
Copy link
Collaborator Author

This should be ready, unless someone objects to #125 (comment). I adjusted the related test in e624e99 so that it passes with the new behavior.

Before merging, I would first register version 2.0 of CodeTracking, then update JuliaInterpreter, then remove the dev patches in this PR then it will be good to go.

@aviatesk aviatesk self-requested a review July 15, 2025 13:49
@aviatesk
Copy link
Member

I slightly restructured the implementation for method code edge dependencies in 8548679, and naturally expected a function binding to depend on its declaration, but not on the method definition. @aviatesk or @timholy would that be more correct according to you, or is it a regression?

I apologize for the delayed response.
I have now conducted the review.
Regarding this point, I think the new behavior is fine. I believe it's more natural to depend on the 1-arg :method.
By the way, could you explain why that change resolves this test failure? I was thinking that the function declaration would be selected in any case when tracked from GlobalRef(ModEval, :revise538).

Also, how would you like to proceed with the entire ecosystem to adapt to this change? I don't have an write access to CodeTracking.jl so we need to ask @timholy to make a release if we need to release a new version of it first.

Co-authored-by: Shuhei Kadowaki <40514306+aviatesk@users.noreply.github.com>
@serenity4
Copy link
Collaborator Author

By the way, could you explain why that change resolves this test failure? I was thinking that the function declaration would be selected in any case when tracked from GlobalRef(ModEval, :revise538).

The test was working fine before that, it's just that one of the changes I made goes in the direction of only reevaluating the function definition, not the method definition. It is a small change that can be removed without compromising this PR, that I thought would be good to have. As we were testing that the method definition was reevaluated, I simply updated the test to test that no method gets reevaluated, because we then only reevaluate the function definition.

@serenity4
Copy link
Collaborator Author

For the release of CodeTracking v2, I opened JuliaDebug/CodeTracking.jl#142.

@serenity4 serenity4 force-pushed the support-external-methodtables branch from a1091d3 to 2cada0d Compare July 24, 2025 19:27
@timholy
Copy link
Member

timholy commented Jul 25, 2025

I also agree that the new behavior is better.

@timholy timholy closed this Jul 25, 2025
@timholy timholy reopened this Jul 25, 2025
@timholy timholy closed this Jul 26, 2025
@timholy timholy reopened this Jul 26, 2025
@timholy timholy closed this Jul 26, 2025
@timholy timholy reopened this Jul 26, 2025
@timholy
Copy link
Member

timholy commented Jul 26, 2025

Green! Merge at will, @serenity4

@serenity4 serenity4 merged commit 3b60b6a into JuliaDebug:master Jul 26, 2025
9 of 62 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants