Macros seem to be expanded in their own sub-scope

[tmcdonell]

Description

Code item macros seem to be expanded in their own scope, rather than into the surrounding scope they were called in. This means that operations such as defer will be executed immediately, rather than at the end of the enclosing scope as one would expect (and as described in the official example here).

Reproduction

Minimal reproducer is here: https://github.com/tmcdonell/swift-issue-73707-example

The macro adds a defer { print( ... ) } statement that should be printed right before the function exits.

> swift run
Building for debugging...
[7/7] Applying DeferClient
Build of product 'DeferClient' complete! (0.46s)
=== Expected ===
hello, sailor
exiting function expected()
=== Actual ===
exiting function actual()
hello, sailor

Expected behavior

The deferred print statement should be executed at the end of the function scope.

Environment

Tested with:

• Apple Swift version 6.0-dev (LLVM cef183591317ec7, Swift 66e3110)
• Apple Swift version 6.0-dev (LLVM 5b202efbc95a8bf, Swift a17d360)
• Apple Swift version 5.10-dev (LLVM 57d4e30156f5d21, Swift c05dd0b)
• Apple Swift version 5.10 (swift-5.10-RELEASE)
• Apple Swift version 5.9 (swift-5.9-RELEASE)

Target: arm64-apple-macosx14.0

Additional information

Tangentially related: #72307 Since 5.10 it is (correctly) no longer possible to work around this using a declaration macro

[tmcdonell]

Correction, it seems like using a freestanding declaration method never worked either. I just tested the example from #72307 and that also executes the defer statement immediately (swift-5.9-release). Same as if I change this example to a declaration macro.

@i2h3 if I just add some print statements to your example I get the following:

> swift run
Building for debugging...
[8/8] Linking SignpostClient
Build complete! (1.49s)
Signpost begin: sayHello()
Signpost defer: sayHello()
Hello!

Did you also encounter this behaviour (in your larger application)?

Edit: For completeness, here is the diff:

diff --git a/Sources/SignpostMacros/SignpostMacro.swift b/Sources/SignpostMacros/SignpostMacro.swift
index c5fb8a8..b9a3677 100644
--- a/Sources/SignpostMacros/SignpostMacro.swift
+++ b/Sources/SignpostMacros/SignpostMacro.swift
@@ -10,9 +10,11 @@ public struct SignpostMacro: DeclarationMacro {
                 stringLiteral: """
                 let signpostID = signposter.makeSignpostID()
                 let signpostIntervalState = signposter.beginInterval(#function, id: signpostID)
+                print("Signpost begin: \\(#function)")
 
                 defer {
                     signposter.endInterval(#function, signpostIntervalState)
+                    print("Signpost defer: \\(#function)")
                 }
                 """
             ),

[tmcdonell]

According to the description of how macros are expanded, it seems that point (3) is not accurate; the compiler does not replace the macro call with its expanded form, rather it puts the expansion in a sub-tree and replaces the call with that. The diagram above this list also seems to imply the expansion should happen inline, but that doesn't appear to be the behaviour I am observing. Or, am I just doing something wrong? Any advice?

[i2h3]

Did you also encounter this behaviour (in your larger application)?

I am sorry, I did not notice it and cannot tell by now because I removed all macro-based logging from our codebase shortly after to move on.

[tmcdonell]

I am sorry, I did not notice it and cannot tell by now because I removed all macro-based logging from our codebase shortly after to move on.

Okay no problem, thank you for letting me know! (:
I also had to abandon macros from our codebase to move on...