chore: Migrate gsutil usage to gcloud storage

[gurusai-voleti]

Release Note Template for Downstream PRs (will be copied)

See Write release notes for guidance.

dataproc: update gsutil usage to gcloud storage

[github-actions]

Hello! I am a robot. Tests will require approval from a repository maintainer to run.

Googlers: For automatic test runs see go/terraform-auto-test-runs.

@ScottSuarez, a repository maintainer, has been assigned to review your changes. If you have not received review feedback within 2 business days, please leave a comment on this PR asking them to take a look.

You can help make sure that review is quick by doing a self-review and by running impacted tests locally.

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 1 file changed, 1 insertion(+), 1 deletion(-))
google-beta provider: Diff ( 1 file changed, 1 insertion(+), 1 deletion(-))

[modular-magician]

Tests analytics

Total tests: 78
Passed tests: 71
Skipped tests: 6
Affected tests: 1

Click here to see the affected service packages

• dataproc

Action taken

Found 1 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests

• TestAccDataprocCluster_withInitAction

Get to know how VCR tests work

[modular-magician]

🔴 Tests failed during RECORDING mode:
TestAccDataprocCluster_withInitAction [Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

[ScottSuarez]

ERROR: (gcloud) Invalid choice: 'storage'.
This command is available in one or more alternate release tracks.  Try:
  gcloud alpha storage

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 1 file changed, 1 insertion(+), 1 deletion(-))
google-beta provider: Diff ( 1 file changed, 1 insertion(+), 1 deletion(-))

[modular-magician]

Tests analytics

Total tests: 78
Passed tests: 71
Skipped tests: 6
Affected tests: 1

Click here to see the affected service packages

• dataproc

Action taken

Found 1 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests

• TestAccDataprocCluster_withInitAction

Get to know how VCR tests work

[modular-magician]

🔴 Tests failed during RECORDING mode:
TestAccDataprocCluster_withInitAction [Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

[gurusai-voleti]

ERROR: (gcloud) Invalid choice: 'storage'.

I tried it, but again got error

[ScottSuarez]

I am not certain - I also get this error locally when trying to use gcloud storage cat.. Other commands work fine for whatever reason. Perhaps there is a bug with gcloud storage cat ?

[gurusai-voleti]

I am not certain - I also get this error locally when trying to use gcloud storage cat.. Other commands work fine for whatever reason. Perhaps there is a bug with gcloud storage cat ?

any other error have you seen the logs, can you please share it