Skip to content

Conversation

@tomviner
Copy link
Collaborator

@tomviner tomviner commented Jan 15, 2018

This PR is based on the first commit of versae#54 but rebased so it's mergable with master.

With few extra commits to:

  • remove ipdb
  • fix streaming
  • update to new urls format
  • convert management command to argparse format

Upstream submission.

Kyle Agronick and others added 6 commits January 5, 2018 16:43
Fixed to work with newest version of Django.
Using StringIO to write one line at a time before flushing it is very slow. Reports download at about 5kbps. Also, previously the reports were created in memory and large reports would cause the server to run out of memory. This change causes the results to be written to the response while they are being read from the database. It never runs out of memory and runs at 600kbps.
The same change is on the HTML view as well. The same problem can present itself if the user selects to view all records. The raw cursor is passed instead of a list of results.
Copy link
Collaborator

@heindsight heindsight left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tomviner tomviner merged commit 1b167d4 into versae-master Jan 15, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants