AWS Access Key Id you provided does not exist in our records - Dataflow job failed

[rajkumarjai1]

Getting the below error when running Dataflow job to access the S3 objects. What's the reason?

com.amazonaws.services.s3.model.AmazonS3Exception: The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: YBX2048SKMH85GS0; S3 Extended Request ID:

mvn compile exec:java \

-Dexec.mainClass=com.harland.example.batch.BigQueryImportPipeline \

-Dexec.args="--project=raj-box \

--bucketUrl=s3://raj-box/transfers_july.csv \

--awsRegion=ap-south-1 \

--bqTableName=raj-box:finance.currencytransactions \

--awsAccessKey='****' \

--awsSecretKey='****' \

--runner=DataflowRunner \

--region=asia-south1 \

--stagingLocation=gs://raj-box/output/stage/ \

--tempLocation=gs://raj-box/temp \

--subnetwork=https://www.googleapis.com/compute/v1/projects/raj-box/regions/asia-south1/subnetworks/default \

--usePublicIps=false"

 In place of '****', I'm giving my AWS Access Key and Secret key.

[Roderick]

Hi @rajkumarjai1,

Based on my research, the error message "The AWS Access Key Id you provided does not exist in our records" indicates that there's an issue with the credentials that you're using. The access key that you're using might have been deleted, or the associated AWS Identity and Access Management (IAM) role or user might have been deleted.

Here are some possible solutions you may or may not have considered:

• Make sure that you're using the correct AWS Access Key ID and Secret Access Key.
• Check if your AWS Access Key ID and Secret Access Key have been revoked.
• If you're using an IAM role, make sure that the role has the necessary permissions to access S3.
• If you're using an IAM user, make sure that the user has the necessary permissions to access S3.

If you're still having trouble, please contact AWS support for further assistance.

Sources - Learn more

1. aws.amazon.com/premiumsupport/knowledge-center/s3-access-key-error/

I hope this helps,