Skip to content

32 EPIPE error on uploading oversized files #29

Description

@francoislaurent

In upload mode:

26/05 17:26 escale.*[DEBUG]       index.upload:281        uploading update data for page '*'
26/05 17:27 escale.*[DEBUG]       client.send:207 Connection aborted.
26/05 17:27 escale.*[CRITICAL]    manager.run:351 Traceback (most recent call last):
  File "escale/manager/manager.py", line 303, in run
    new |= self.upload()
  File "escale/manager/index.py", line 282, in upload
    self.relay.setUpdateData(page, final_file)
  File "escale/relay/index.py", line 884, in setUpdateData
    self.base_relay._push(data, self.updateData(page, mode='w'))
  File "escale/relay/webdav/webdav.py", line 196, in _push
    self.upload(local_file, remote_file)
  File "escale/relay/webdav/client.py", line 262, in upload
    retry_on_status_codes=(302, 413, 503, 504))
  File "escale/relay/webdav/client.py", line 177, in send
    response = self.session.request(method, url, allow_redirects=allow_redirects, **kwargs)
  File "$HOME/.local/lib/python2.7/site-packages/requests/sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "$HOME/.local/lib/python2.7/site-packages/requests/sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "$HOME/.local/lib/python2.7/site-packages/requests/adapters.py", line 490, in send
    raise ConnectionError(err, request=request)
ConnectionError: ('Connection aborted.', error("(32, 'EPIPE')",))

Followed by:

26/05 17:27 escale.*[DEBUG]       index.repairUpdates:733 releasing remnant lock for page '*'
26/05 17:31 escale.*[DEBUG]       manager.localFiles:572  number of local files: (total) 2706122  (readable) 2706122
26/05 17:31 escale.*[DEBUG]       index.upload:234        page '*' has 0 entries (locally: 2)
26/05 17:43 escale.*[DEBUG]       index.upload:281        uploading update data for page '*'
26/05 17:43 escale.*[DEBUG]       client.send:207 Connection aborted.
26/05 17:43 escale.*[DEBUG]       manager.run:348 ('Connection aborted.', error("(32, 'EPIPE')",))
26/05 17:43 escale.*[DEBUG]       timer.wait:107  sleeping 450 seconds

Which endlessly repeats.

EDIT: the update contains a single files that is 3.5GiB, which is larger than the available storage size on the cloud. This is the actual problem. If it cannot be prevented, then the above error could be considered for detecting such a situation.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions