Mercurial > hgsubversion
annotate .hgignore @ 931:e1dbd9646d6a
svnwrap: use custom StringIO class in get_file()
The wrappers were calling ra.get_file() with a cStringIO object.
Empirically, svn 1.7.5 is writing 16kB blocks to the stream object, and
cStringIO reallocates its internal buffer and doubles its size whenever
it is filled. With large committed files this requires two large
memory blocks at the same time.
SimpleStringIO implements the mimimum StringIO interface used by
ra.get_file() but instead stores all the blocks and "join" them at the
end. It means more fragmentation but requires only one large block,
without overallocation. Also, 16kB blocks should be friendly to most
allocators.
In practice, this simple change let me convert a revision containing
multiple moderately large files, the largest being around 450MB, with a
32-bits Windows setup, python 2.7, swig svn 1.7.5, in stupid mode, while
it was previously aborting with "not enough memory". The same revision
still fails in replay mode.
author | Patrick Mezard <patrick@mezard.eu> |
---|---|
date | Sun, 16 Sep 2012 19:31:49 +0200 |
parents | e42a05915edf |
children | 60324fc7e4d7 |
rev | line source |
---|---|
0
f2636cfed115
Initial import of hgsubversion into a public repository.
Augie Fackler <durin42@gmail.com>
parents:
diff
changeset
|
1 syntax:glob |
340
88ba55ad58c0
Minor tweaks to wrapper documentation.
Dan Villiom Podlaski Christiansen <danchr@gmail.com>
parents:
319
diff
changeset
|
2 build |
0
f2636cfed115
Initial import of hgsubversion into a public repository.
Augie Fackler <durin42@gmail.com>
parents:
diff
changeset
|
3 *.pyc |
292
761b095c11fb
Also ignore .pyo files.
Dan Villiom Podlaski Christiansen <danchr@gmail.com>
parents:
137
diff
changeset
|
4 *.pyo |
0
f2636cfed115
Initial import of hgsubversion into a public repository.
Augie Fackler <durin42@gmail.com>
parents:
diff
changeset
|
5 .DS_Store |
21
8626f3d2e50b
Add a small stack of tests that exercise some of the interesting special cases.
Augie Fackler <durin42@gmail.com>
parents:
0
diff
changeset
|
6 *.swp |
54
db7a1ab8851a
.hgignore: ignore emacs temporary files
Patrick Mezard <pmezard@gmail.com>
parents:
21
diff
changeset
|
7 *~ |
21
8626f3d2e50b
Add a small stack of tests that exercise some of the interesting special cases.
Augie Fackler <durin42@gmail.com>
parents:
0
diff
changeset
|
8 .coverage |
137
904a4b08f70f
.hgignore: ignore nose coverage html.
Augie Fackler <durin42@gmail.com>
parents:
61
diff
changeset
|
9 cover |
61
243c88c47d89
Ignore coverage information.
Augie Fackler <durin42@gmail.com>
parents:
54
diff
changeset
|
10 *.py,cover |
319
9c10656ce71e
Ignore distutils generated files.
Augie Fackler <durin42@gmail.com>
parents:
292
diff
changeset
|
11 MANIFEST |
9c10656ce71e
Ignore distutils generated files.
Augie Fackler <durin42@gmail.com>
parents:
292
diff
changeset
|
12 dist |
353
1ad05cffb20f
setup.py: Use setuptools if available.
Augie Fackler <durin42@gmail.com>
parents:
340
diff
changeset
|
13 *.egg-info |
525
6b084ea39537
hgignore: ignore the version file
Augie Fackler <durin42@gmail.com>
parents:
353
diff
changeset
|
14 hgsubversion/__version__.py |
823 | 15 nbproject |
824
38ebdf65d868
Ignore eclipse project files and mercurial .orig files.
Yonggang Luo <luoyonggang@gmail.com>
parents:
525
diff
changeset
|
16 .project |
38ebdf65d868
Ignore eclipse project files and mercurial .orig files.
Yonggang Luo <luoyonggang@gmail.com>
parents:
525
diff
changeset
|
17 .pydevproject |
38ebdf65d868
Ignore eclipse project files and mercurial .orig files.
Yonggang Luo <luoyonggang@gmail.com>
parents:
525
diff
changeset
|
18 .settings |
38ebdf65d868
Ignore eclipse project files and mercurial .orig files.
Yonggang Luo <luoyonggang@gmail.com>
parents:
525
diff
changeset
|
19 *.orig |
909
e42a05915edf
Add .noseids to the .hgignore
David Schleimer <dschleimer@fb.com>
parents:
903
diff
changeset
|
20 .noseids |
903
fd9397c863d4
ignore the temp fixtures directory
Bryan O'Sullivan <bryano@fb.com>
parents:
830
diff
changeset
|
21 tests/fixtures/temp |