Skip to content

Are parallel file uploads possible? #5

Closed

Description

@Danita

Hi! Thanks for this module, looks great 😄

I was wondering if it's possible to upload all files simultaneously instead of one by one. If so, how do I configure the component?

Activity

  1. nervgh commented on Sep 27, 2013

    @nervgh
    Owner

    Hi! The current implementation does not allow to upload files simultaneously. But if you can convince me that it is necessary, I will try to add it in the next version : )

  2. tamtakoe commented on Oct 2, 2013

    @tamtakoe

    Hi! I test parallel and alternate uploads in my module. It work the same time. Parallel uploads worse for total progress calculating. If you use parallel files uploads and there was a disconnect, then you will lose all the files are not loaded. if you use alternate uploads, then you will lose only one file

  3. Danita commented on Oct 2, 2013

    @Danita
    ContributorAuthor

    Hi @tamtakoe, what do you mean "your module"? Do you have a fork of this project? And what do you mean by "alternate" uploads?

  4. tamtakoe commented on Oct 2, 2013

    @tamtakoe

    https://github.com/tamtakoe/oi.file But it was previous version (you can see it in commit history). Now I remove parallel uploading. alternate — uploading in turn

  5. Danita commented on Oct 2, 2013

    @Danita
    ContributorAuthor

    Oh, I see. Thanks. But when I'm referring to parallel uploads you seem to assume that I mean several files uploading in a single form. What I propose instead is posting several forms, each one with a single file to upload.

  6. tamtakoe commented on Oct 2, 2013

    @tamtakoe

    Ok. I understand now. When you upload files in one form you get some problem: server limit divided by the total number of files, it is impossible to know the progress of each file

  7. jamshid commented on Jun 5, 2014

    @jamshid

    Sorry I don't understand why multiple files cannot be written (as multiple simultaneous PUT requests).

    Is it that you just haven't chosen to implement it, or is it simply not possible? It seems browsers now allow at least a few simultaneous connections to a host:
    http://stackoverflow.com/questions/985431/max-parallel-http-connections-in-a-browser

  8. tamtakoe commented on Jun 5, 2014

    @tamtakoe

    @jamshid where I can see perfomance tests?

  9. jamshid commented on Jun 6, 2014

    @jamshid

    Is there a way for me to enable multiple simultaneous connections so I can test? I'm not a javascript / FileAPI expert but would be happy to test.

    As a possibly unrelated data point, uploading 250 small files via the jets3t "synchronize.sh" java command-line tool normally takes 64 secs, but drops to 7 secs if I increase the thread count with these settings:

    httpclient.max-connections=25
    storage-service.admin-max-thread-count=25
    threaded-service.max-thread-count=25
    
  10. bushev commented on Oct 5, 2015

    @bushev

    Hi gyes!

    It's possible to to upload several files simultaneously now? :-)

    I have a very big latency with file processing (due to uploading to rackspace) and I can't force my users wait so much time. Rackspace support to 100 operation per a container per a second.

    It would be a great feature of this uploader!

  11. added this to the 3.0.0 milestone on Oct 6, 2015
  12. wallstudios commented on Apr 7, 2017

    @wallstudios

    Any idea on when this feature will be included?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions