Packages

c

com.mfglabs.commons.aws.s3

AmazonS3ClientMaterialized

class AmazonS3ClientMaterialized extends AmazonS3Client

Additional functions which materialize stream to Future.

Source
AmazonS3ClientMaterialized.scala
Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AmazonS3ClientMaterialized
  2. AmazonS3Client
  3. AmazonS3Wrapper
  4. MethodWrapper
  5. AnyRef
  6. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AmazonS3ClientMaterialized(client: AmazonS3, executorService: ExecutorService, flowMaterializer: ActorMaterializer)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to any2stringadd[AmazonS3ClientMaterialized] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ->[B](y: B): (AmazonS3ClientMaterialized, B)
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to ArrowAssoc[AmazonS3ClientMaterialized] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  5. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  6. def abortMultipartUpload(req: AbortMultipartUploadRequest): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  7. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  8. val client: AmazonS3
    Definition Classes
    AmazonS3ClientAmazonS3Wrapper
  9. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def completeMultipartUpload(completeMultipartUploadRequest: CompleteMultipartUploadRequest): Future[CompleteMultipartUploadResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  11. def copyObject(sourceBucketName: String, sourceKey: String, destinationBucketName: String, destinationKey: String): Future[CopyObjectResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  12. def copyObject(copyObjectRequest: CopyObjectRequest): Future[CopyObjectResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  13. def copyPart(copyPartRequest: CopyPartRequest): Future[CopyPartResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  14. def createBucket(bucketName: String, region: String): Future[Bucket]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  15. def createBucket(bucketName: String, region: Region): Future[Bucket]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  16. def createBucket(bucketName: String): Future[Bucket]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  17. def createBucket(createBucketRequest: CreateBucketRequest): Future[Bucket]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  18. def deleteBucket(bucketName: String): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  19. def deleteBucket(deleteBucketRequest: DeleteBucketRequest): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  20. def deleteObject(bucketName: String, key: String): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  21. def deleteObject(deleteObjectRequest: DeleteObjectRequest): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  22. def deleteObjects(bucket: String, commonPrefix: String): Future[Seq[DeletedObject]]
  23. def deleteObjects(bucketName: String, keys: String*): Future[Seq[DeletedObject]]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  24. def deleteObjects(deleteObjectsRequest: DeleteObjectsRequest): Future[Seq[DeletedObject]]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  25. def deleteVersion(bucketName: String, key: String, versionId: String): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  26. def deleteVersion(deleteVersionRequest: DeleteVersionRequest): Future[Unit]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  27. def doesBucketExist(bucketName: String): Future[Boolean]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  28. implicit val ec: ExecutionContextExecutorService
    Definition Classes
    AmazonS3Wrapper
  29. implicit lazy val ecForBlockingOps: ExecutionContextForBlockingOps
    Definition Classes
    AmazonS3Client
  30. def ensuring(cond: (AmazonS3ClientMaterialized) ⇒ Boolean, msg: ⇒ Any): AmazonS3ClientMaterialized
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to Ensuring[AmazonS3ClientMaterialized] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  31. def ensuring(cond: (AmazonS3ClientMaterialized) ⇒ Boolean): AmazonS3ClientMaterialized
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to Ensuring[AmazonS3ClientMaterialized] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  32. def ensuring(cond: Boolean, msg: ⇒ Any): AmazonS3ClientMaterialized
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to Ensuring[AmazonS3ClientMaterialized] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  33. def ensuring(cond: Boolean): AmazonS3ClientMaterialized
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to Ensuring[AmazonS3ClientMaterialized] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  34. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  35. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  36. val executorService: ExecutorService
    Definition Classes
    AmazonS3ClientAmazonS3WrapperMethodWrapper
  37. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  38. implicit val flowMaterializer: ActorMaterializer
  39. def formatted(fmtstr: String): String
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to StringFormat[AmazonS3ClientMaterialized] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  40. def generatePresignedUrlRequest(generatePresignedUrlRequest: GeneratePresignedUrlRequest): Future[URL]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  41. def getBucketLocation(bucketName: String): Future[String]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  42. def getBucketLocation(getBucketLocationRequest: GetBucketLocationRequest): Future[String]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  43. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  44. def getFile(bucket: String, key: String): Future[ByteString]

    Get a S3 file.

    Get a S3 file.

    returns

    binary file

  45. def getFileAsStream(bucket: String, key: String, inputStreamTransform: (InputStream) ⇒ InputStream = identity): Source[ByteString, NotUsed]

    Stream a S3 file.

    Stream a S3 file.

    bucket

    the bucket name

    key

    the key of file

    inputStreamTransform

    optional inputstream transformation (for example GZIP decompression, ...)

    Definition Classes
    AmazonS3Client
  46. def getMultipartFileAsStream(bucket: String, prefix: String, inputStreamTransform: (InputStream) ⇒ InputStream = identity): Source[ByteString, NotUsed]

    Stream sequentially a SE multipart file.

    Stream sequentially a SE multipart file.

    bucket

    S3 bucket

    prefix

    S3 prefix. Files of path prefix* will be taken into account.

    inputStreamTransform

    optional inputstream transformation (for example GZIP decompression, ...)

    Definition Classes
    AmazonS3Client
  47. def getObject(getObjectRequest: GetObjectRequest, destinationFile: File): Future[ObjectMetadata]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  48. def getObject(bucketName: String, key: String): Future[S3Object]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  49. def getObject(getObjectRequest: GetObjectRequest): Future[S3Object]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  50. def getObjectMetadata(bucketName: String, key: String): Future[ObjectMetadata]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  51. def getObjectMetadata(getObjectMetadataRequest: GetObjectMetadataRequest): Future[ObjectMetadata]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  52. def hashCode(): Int
    Definition Classes
    AnyRef → Any
  53. def initiateMultipartUpload(initiateMultipartUploadRequest: InitiateMultipartUploadRequest): Future[InitiateMultipartUploadResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  54. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  55. def listBuckets(): Future[Seq[Bucket]]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  56. def listBuckets(listBucketsRequest: ListBucketsRequest): Future[Seq[Bucket]]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  57. def listFiles(bucket: String, path: Option[String] = None): Future[Seq[S3ObjectSummary]]

    List all files with a given prefix of a S3 bucket.

    List all files with a given prefix of a S3 bucket.

    bucket

    the bucket name

    path

    an optional path to search in bucket

    returns

    a future of seq of file keys & last modified dates (or a failure)

  58. def listFilesAsStream(bucket: String, maybePrefix: Option[String] = None): Source[S3ObjectSummary, NotUsed]

    List all files with a given prefix of a S3 bucket.

    List all files with a given prefix of a S3 bucket.

    bucket

    S3 bucket

    maybePrefix

    S3 prefix. If not present, all the files of the bucket will be returned.

    Definition Classes
    AmazonS3Client
  59. def listNextBatchOfObjects(req: ObjectListing): Future[ObjectListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  60. def listNextBatchOfObjects(req: ListNextBatchOfObjectsRequest): Future[ObjectListing]

  61. def listObjects(bucketName: String, prefix: String): Future[ObjectListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  62. def listObjects(bucketName: String): Future[ObjectListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  63. def listObjects(listObjectsRequest: ListObjectsRequest): Future[ObjectListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  64. def listVersions(bucketName: String, prefix: String, keyMarker: String, versionIdMarker: String, delimiter: String, maxKeys: Int): Future[VersionListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  65. def listVersions(bucketName: String, prefix: String): Future[VersionListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  66. def listVersions(listVersionsRequest: ListVersionsRequest): Future[VersionListing]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  67. def materialized(flowMaterializer: ActorMaterializer): AmazonS3ClientMaterialized

    Return a client with additional logic to obtain a Stream logic as a Future.

    Return a client with additional logic to obtain a Stream logic as a Future.

    Definition Classes
    AmazonS3Client
  68. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  69. final def notify(): Unit
    Definition Classes
    AnyRef
  70. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  71. def putObject(bucketName: String, key: String, input: InputStream, metadata: ObjectMetadata): Future[PutObjectResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  72. def putObject(bucketName: String, key: String, file: File): Future[PutObjectResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  73. def putObject(putObjectRequest: PutObjectRequest): Future[PutObjectResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  74. def shutdown(): Unit

    Shutdown the client and the executor service.

    Shutdown the client and the executor service.

    Definition Classes
    AmazonS3ClientMaterializedAmazonS3Wrapper
    See also

    AmazonWebServiceClient.shutdown()

  75. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  76. def toString(): String
    Definition Classes
    AnyRef → Any
  77. def uncompressGzippedFileAsStream(bucket: String, key: String): Source[ByteString, NotUsed]

    Stream a gzipped S3 file and decompress it on the fly.

    Stream a gzipped S3 file and decompress it on the fly.

    bucket

    S3 bucket

    key

    S3 key

    Definition Classes
    AmazonS3Client
  78. def uploadPart(req: UploadPartRequest): Future[UploadPartResult]

    Definition Classes
    AmazonS3Wrapper
    See also

    AWS Java SDK

  79. def uploadStreamAsFile(intiate: InitiateMultipartUploadRequest, chunkUploadConcurrency: Int): Flow[ByteString, CompleteMultipartUploadResult, NotUsed]
    Definition Classes
    AmazonS3Client
  80. def uploadStreamAsFile(bucket: String, key: String, chunkUploadConcurrency: Int = 1): Flow[ByteString, CompleteMultipartUploadResult, NotUsed]

    Upload a stream of bytes as a S3 file and returns an element of type CompleteMultipartUploadResult (or nothing if upstream was empty).

    Upload a stream of bytes as a S3 file and returns an element of type CompleteMultipartUploadResult (or nothing if upstream was empty).

    bucket

    S3 bucket

    key

    S3 key

    chunkUploadConcurrency

    chunk upload concurrency. Order is guaranteed even with chunkUploadConcurrency > 1.

    Definition Classes
    AmazonS3Client
  81. def uploadStreamAsMultipartFile(bucket: String, getKey: (Long) ⇒ String, nbChunkPerFile: Int): Flow[ByteString, CompleteMultipartUploadResult, NotUsed]
    Definition Classes
    AmazonS3Client
  82. def uploadStreamAsMultipartFile(bucket: String, getKey: (Long) ⇒ String, nbChunkPerFile: Int, chunkUploadConcurrency: Int): Flow[ByteString, CompleteMultipartUploadResult, NotUsed]

    Upload a stream as a multipart file with a given number of upstream chunk per file.

    Upload a stream as a multipart file with a given number of upstream chunk per file. Part file are uploaded sequentially but chunk inside a part file can be uploaded concurrently (tuned with chunkUploadConcurrency). The Flow returns a CompleteMultipartUploadResult for each part file uploaded.

    bucket

    S3 bucket

    getKey

    S3 key factory that will generate a new key for each part file based on the index of upstream chunks...

    nbChunkPerFile

    the number of upstream chunks (for example lines) to include in each part file

    chunkUploadConcurrency

    chunk upload concurrency. Order is guaranteed even with chunkUploadConcurrency > 1.

    Definition Classes
    AmazonS3Client
  83. def uploadStreamAsMultipartFile(bucket: String, prefix: String, nbChunkPerFile: Int, chunkUploadConcurrency: Int = 1): Flow[ByteString, CompleteMultipartUploadResult, NotUsed]

    Upload a stream as a multipart file with a given number of upstream chunk per file.

    Upload a stream as a multipart file with a given number of upstream chunk per file. Part file are uploaded sequentially but chunk inside a part file can be uploaded concurrently (tuned with chunkUploadConcurrency). The Flow returns a CompleteMultipartUploadResult for each part file uploaded.

    bucket

    S3 bucket

    prefix

    S3 prefix. The actual part files will be named prefix.part.00000001, prefix.part.00000002, ...

    nbChunkPerFile

    the number of upstream chunks (for example lines) to include in each part file

    chunkUploadConcurrency

    chunk upload concurrency. Order is guaranteed even with chunkUploadConcurrency > 1.

    Definition Classes
    AmazonS3Client
  84. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  85. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  86. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  87. def wrapMethod[Request, Result](f: (Request) ⇒ Result, request: Request): Future[Result]
    Definition Classes
    MethodWrapper
    Annotations
    @inline()
  88. def [B](y: B): (AmazonS3ClientMaterialized, B)
    Implicit
    This member is added by an implicit conversion from AmazonS3ClientMaterialized to ArrowAssoc[AmazonS3ClientMaterialized] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from AmazonS3Client

Inherited from AmazonS3Wrapper

Inherited from MethodWrapper

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from AmazonS3ClientMaterialized to any2stringadd[AmazonS3ClientMaterialized]

Inherited by implicit conversion StringFormat from AmazonS3ClientMaterialized to StringFormat[AmazonS3ClientMaterialized]

Inherited by implicit conversion Ensuring from AmazonS3ClientMaterialized to Ensuring[AmazonS3ClientMaterialized]

Inherited by implicit conversion ArrowAssoc from AmazonS3ClientMaterialized to ArrowAssoc[AmazonS3ClientMaterialized]

Ungrouped