[BUG] AwsObjectStorage#doList only list first 1000 object

[superhx]

AutoMQ Version

all

Operating System

all

Installation Method

source

Hardware Configuration

No response

Other Relevant Software

No response

What Went Wrong?

The #doList should support list more than 1000 object by prefix.

automq/s3stream/src/main/java/com/automq/stream/s3/operator/AwsObjectStorage.java

Lines 364 to 371 in 7c9cdd0

	CompletableFuture<List<ObjectInfo>> doList(String prefix) {
	return readS3Client.listObjectsV2(builder -> builder.bucket(bucket).prefix(prefix))
	.thenApply(resp ->
	resp.contents()
	.stream()
	.map(object -> new ObjectInfo(bucketURI.bucketId(), object.key(), object.lastModified().toEpochMilli(), object.size()))
	.collect(Collectors.toList()));
	}

• https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjectsV2.html

What Should Have Happened Instead?

Steps to Reproduce

Additional Information

No response