Skip to content

  • Projects
  • Groups
  • Snippets
  • Help
  • This project
    • Loading...
  • Sign in / Register
M
migration_scripts
  • Project
    • Overview
    • Details
    • Activity
    • Cycle Analytics
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Charts
  • Issues 0
    • Issues 0
    • List
    • Board
    • Labels
    • Milestones
  • Merge Requests 0
    • Merge Requests 0
  • CI / CD
    • CI / CD
    • Pipelines
    • Jobs
    • Schedules
    • Charts
  • Registry
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Collapse sidebar
  • Activity
  • Graph
  • Charts
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
  • serpucga
  • migration_scripts
  • Repository

Switch branch/tag
  • migration_scripts
  • pymongoexport_csv.py
Find file
BlameHistoryPermalink
  • serpucga's avatar
    Error handling added · 662b9e66
    serpucga authored Jul 22, 2019
    The system should now be capable of overcoming a failure during the
    process of conversion, either by ignoring the error or by dumping the
    state at the moment of failure and allowing to resume the process later
    from the point where it was stopped.
    
    The policies followed at this stage for avoiding corrupt data or other
    errors are the following:
    1. If an specific tweet raises an error in the process of being
    converted to CSV, the tweet is skipped and the whole execution
    continues.
    2. If there is any other error when processing a page of tweets, the
    number of that page is recorded in the recovery file, and that page will
    be skipped when the user tries to resume the execution from the recovery
    file.
    3. If any other unexpected error, keyboard interruption or anything
    happened, a standard recovery file will be dumped, with the list of
    already converted pages but without "error_page", so when executing the
    script with the flag "-r", the program will try to resume the execution
    from the point where it was left without discarding any info.
    662b9e66
pymongoexport_csv.py 3.95 KB
EditWeb IDE
×

Replace pymongoexport_csv.py

Attach a file by drag & drop or click to upload


Cancel
A new branch will be created in your fork and a new merge request will be started.