Closed Bug 1213052 Opened 9 years ago Closed 7 years ago

Analyze what we could improve in the virtualenv action

Categories

(Release Engineering :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: armenzg, Unassigned)

References

(Blocks 1 open bug)

Details

I've looked at the log of a WinXP crashtest job [1] and I'm pasting below the output of the virtualenv action without certain parameters for ease of analysis. You can see the orignal output in [2]

We try to install mozbase 4 times.
We clobber the cache every time (bug 1209112)
We try to install psutil twice.
Packages like psutil, mozsystemmonitor, blobuploader, pip, mock, simplejson should always come from the cache.
We might want to add clobberer support for clearing the venv cache.

c:\mozilla-build\python27\python.exe c:/mozilla-build/buildbotve/virtualenv.py --no-site-packages --distribute C:\slave\test\build\venv
pip install psutil>=0.7.1
pip install mozsystemmonitor==0.0.0
pip install blobuploader==1.2.4
pip install --no-deps -r C:\slave\test\build\tests\config\mozbase_requirements.txt 
pip install -r C:\slave\test\build\tests\config\mozbase_requirements.txt 
pip install pip>=1.5
pip install psutil==3.1.1
pip install mock
pip install simplejson
pip install --no-deps -r C:\slave\test\build\tests\config\mozbase_requirements.txt 
pip install -r C:\slave\test\build\tests\config\mozbase_requirements.txt 
pip freeze

### Table of aliases
C:\slave\test\build\venv\Scripts\pip -> pip
--download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub -> empty string
--download-cache C:\slave\test\build\venv\cache --timeout 120 --> empty string
--no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub -> empty string
###

[1] http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1444330947/mozilla-inbound_xp-ix_test-cppunit-bm119-tests1-windows-build780.txt.gz

[2]
c:\mozilla-build\python27\python.exe c:/mozilla-build/buildbotve/virtualenv.py --no-site-packages --distribute C:\slave\test\build\venv
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub psutil>=0.7.1
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub mozsystemmonitor==0.0.0
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub blobuploader==1.2.4
C:\slave\test\build\venv\Scripts\pip install --no-deps --download-cache C:\slave\test\build\venv\cache --timeout 120 -r C:\slave\test\build\tests\config\mozbase_requirements.txt --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 -r C:\slave\test\build\tests\config\mozbase_requirements.txt --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub pip>=1.5
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub psutil==3.1.1
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub mock
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub simplejson
C:\slave\test\build\venv\Scripts\pip install --no-deps --download-cache C:\slave\test\build\venv\cache --timeout 120 -r C:\slave\test\build\tests\config\mozbase_requirements.txt --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub
C:\slave\test\build\venv\Scripts\pip install --download-cache C:\slave\test\build\venv\cache --timeout 120 -r C:\slave\test\build\tests\config\mozbase_requirements.txt --no-index --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub
C:\slave\test\build\venv\Scripts\pip freeze
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → INCOMPLETE
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.