IF YOU WOULD LIKE TO GET AN ACCOUNT, please write an
email to Administrator. User accounts are meant only to access repo
and report issues and/or generate pull requests.
This is a purpose-specific Git hosting for
BaseALT
projects. Thank you for your understanding!
Только зарегистрированные пользователи имеют доступ к сервису!
Для получения аккаунта, обратитесь к администратору.
Add documentation for the containerized imageio
that is provided, showing how to build and run the
image.
Signed-off-by: Albert Esteve <aesteve@redhat.com>
Add venv target to the Makefile, which automatically
creates the Python virtual environment in a
consistent folder and installs all requirements in a
single step.
Signed-off-by: Albert Esteve <aesteve@redhat.com>
Rename docker folder to containers to make
it more generic. Dockerfiles contained in
this folder are also renamed to containerfile.
Update the development document to reflect
the new path.
Fixes: #9
Signed-off-by: Albert Esteve <aesteve@redhat.com>
The base image used for backup tests was created by a pytest fixture.
This is useful since the image is created transparently when needed, but
in CI environment creating the image can be very slow and requires very
long timeouts to avoid random failures.
Move the creation of the image to new "images" target. The "check"
target depends on it so the image will be create automatically when
running "make check".
With this change the backup tests run successfully on all tested
distros. Previously they were skipped on centos 9 since they always
timed out.
Testing shows that the backup tests take 19-23 seconds on github, so 60
seconds timeout should be enough.
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
There is nothing to make before the tests. Running make is recommended
for developers to be able to run the daemon directly from source, but
the tests create the C extension when needed automatically.
Added a new section to docs/developement.md showing how to build and run
the daemon directly from source.
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
* remove `automation` directory with CI files for gerrit
* remove `stdci.yaml`
* update development page with packages required for development
Fixes#8
Update development page:
* replace gerrit instruction with github instructions
* remove info how to run tests on Travis
* replace `yum` with `dnf`
Fixes#53
This make it easier to work with the project and to improve packaging.
For example, README.md is now at the expected location, so it is
packaged automatically for pypi.
Change-Id: Ib1a456054de34146bf2a4f39a69ccf1756b99e41
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
This document needs a major rewrite, but it may be useful for
developers.
Change-Id: I41f579d92f9f02baaef6b3e295b42dccb55f1fd5
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Replace modules.md with outdated information about removed
ovirt-imageio-proxy and never implemented /progress endpoint with new
document about the current packages.
The section about the ovirt-imageio-daemon package updated to describe
the services, endpoints and backends provided by the server.
Change-Id: Ia11dcc1534499f1ec39145ff3942fe565fb74e01
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Remove the section about installing development version on engine host.
The best way to test imageio is to build and install the rpms. Add a
section showing how to do this.
Dealing with engine development environment is handled in engine
documentation.
Change-Id: I57026c2192784134d1ab481b683ffe51014d60c6
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
- Remove the section about generated files, since we don't such file now.
- Clean up the instructions about ordering imports.
Change-Id: Ica971c0416b9d319babce9ea033894c98c9bcde1
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
- Update list of builds to current CI setup.
- Replace travis-ci.org with travis-ci.com.
Change-Id: I48c2d4c9316503740a2c295fddf79f6f782aa9dc
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Update the instructions for running the tests on Fedora 32 using new
tree layout changed in 2.0.0.
Update the section about using local qemu to show also how to use local
qemu-nbd.
Change-Id: Ib2b3e6311b68be523cc89fc61130f30cf835887b
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Remove outdated instructions for Fedora 29 and Centos 7, and replace
with instructions that work on REHL 8/Centos Stream 8 /Fedora 32+.
Replace bad advice to install pip and tox with --user option with
instructions how to create virtual environment.
Change-Id: I1360d51a16353502b73545b8cc36992f435fe697
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
We don't have a commit-template.txt in the source. I think this is
leftover from ovirt-imageio-proxy.
Change-Id: Iab412026257a1673e704bb54fef2f6279ba9ea31
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Since 2.2.0-1 we report also the zero status of a dirty extent. Explain
how this can be used to speed up incremental backup and minimize network
bandwidth and decrease storage for the backup.
Change-Id: I85bd64e000ad5a75fb7937c88833a09ad1d2f109
Bug-Url: https://bugzilla.redhat.com/1971185
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
- A hole is reported regardless of having a backing file.
- Explain better the meaning of a hole.
Change-Id: I1118350d39faa2674158d9f0df336cceaa9c2754
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Move TLS configuration into dedicated confguration page and remove all
references to imageio-proxy from this section. This page will be later
on expanded and more configuration option will be added.
The preview is on
https://github.com/vjuranek/ovirt-imageio/blob/doc_update/docs/configuration.md
Change-Id: Ife93f5dd322411d6db94d4f877963d9c942d88ed
Signed-off-by: Vojtech Juranek <vjuranek@redhat.com>
Current headings for build targets don't work. Instead of using
subsection for each target, use list instead and switch to subsections
if we have more content there.
Change-Id: Ic60412f6d7dc6a541955090fd6fd305c05df78f6
Signed-off-by: Vojtech Juranek <vjuranek@redhat.com>
COPY ../requirements.txt requirements.txt is not compatible with docker,
and it seems that podman was fixed to behave like docker. Move the
requirements file in the docker directory so we can copy it into the
containers.
Change-Id: I31a59eba8159763649c5a24da2a2492511963cab
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Add QEMU environment variable to allow running the tests with private
qemu-kvm executable. This can be useful for testing qemu from git.
To run the test with private qemu-kvm use:
QEMU=/path/to/qemu-kvm tox
Change-Id: Ice13c7c8836f2fa3ab8ff2507b6cfc2a6409cadb
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
This version fixed issue with more_itertools breaking all python
projects lately:
Traceback (most recent call last):
File "/usr/bin/tox", line 7, in <module>
from tox import cmdline
File "/usr/lib/python2.7/site-packages/tox/__init__.py", line 9, in <module>
import pluggy
File "/usr/lib/python2.7/site-packages/pluggy/__init__.py", line 16, in <module>
from .manager import PluginManager, PluginValidationError
File "/usr/lib/python2.7/site-packages/pluggy/manager.py", line 6, in <module>
import importlib_metadata
File "/usr/lib/python2.7/site-packages/importlib_metadata/__init__.py", line 9, in <module>
import zipp
File "/usr/lib/python2.7/site-packages/zipp.py", line 12, in <module>
import more_itertools
File "/usr/lib/python2.7/site-packages/more_itertools/__init__.py", line 1, in <module>
from more_itertools.more import * # noqa
File "/usr/lib/python2.7/site-packages/more_itertools/more.py", line 340
def _collate(*iterables, key=lambda a: a, reverse=False):
^
SyntaxError: invalid syntax
Change-Id: I23e4f35637a21d823a97ab83f1bc302c5317d301
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
We cannot create userstorage with 4k sector size in oVirt CI, so tests
using 4k storage are disabled in oVirt CI. The only way to run these
tests is locally, or on Travis CI.
Add .travis.yaml configuration and travis/test.sh script for running the
tests on Travis, and document current CI solution.
Change-Id: I8b18dcde21e5a769258659cb052c150fbe172ea0
Bug-Url: https://bugzilla.redhat.com/172980
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Add userstorage configuration file (storage.py) defining the storage
devices and files used by the tests.
Before running the tests, developers must create storage for the tests
using:
make storage
The automation script creates the storage for every run, and cleans up
the storage when tests are done.
The storage will be used by the tests in later patches.
Change-Id: I334269e4d83082f8a64d952843ee4ed641a65d67
Bug-Url: https://bugzilla.redhat.com/172980
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Reorganize the document to make it more useful for new developers, and
make room for documenting how to create userstorage for tests.
Older parts of the document are probably broken and need more work.
Change-Id: I6d1a5516f298b9a4c13d63dd20409abfb075eaa0
Bug-Url: https://bugzilla.redhat.com/172980
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Use apache httpd key/cert/ca_cert instead of engine-ca-generated ones.
This should make it easier to use:
- If using engine-ca for apache, user most likely already approved it
in the browser when logging in, so will not have to handle again for
imageio.
- If using 3rd party CA for apache, CA cert likely already added to the
browser.
In a normal upgrade, where the user didn't touch the conf manually,
notify the user and update the proxy conf.
In an upgrade where the user changed the conf manually after setup,
create a new file with a different name and notify the user, suggesting
to check the diff and update.
In an upgrade where the user changed the conf manually after setup, but
changed it to have the content we want it to have with current patch,
only log, but still "update" the file, so that a following setup or
especially cleanup will consider the file "ok" (not changed manually).
The only case that will be broken by current patch is if a user needs,
for some reason, two different certs for the two different https
services on two different ports, on the engine machine. In a discussion
in bugzilla it was decided that this is not an issue.
Bug-Url: https://bugzilla.redhat.com/1637809
Change-Id: I7bed070cfd8a84306e13a941815947e42c94bf3a
Signed-off-by: Yedidyah Bar David <didi@redhat.com>
We don't want people to import our private uhttp module, so include the
UnixHTTPConnection in the documentation.
Change-Id: I52fd37664af29751971404acdecb2b08a2a2b05e
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
An application running on the host preforming a transfer can get the
unix socket address using OPTIONS request. If the "unix_socket" key
exists in the response, the application should use the unix socket to
transfer data for improved throughput and lower CPU usage.
Here is an example request:
OPTIONS /images/ticket-uuid
...
{
"features": ["zero", "flush"],
"unix_socket": "\0/org/ovirt/imageio"
}
Change-Id: I0e448d89ddfe535b2c15937f9243fc687f269a6d
Bug-Url: https://bugzilla.redhat.com/1585675
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
Extracted information scattered in readme files
to an external docs folder.
Change-Id: I2ca4786a4d0a152cf4a5427842129fc63934066a
Signed-off-by: Daniel Erez <derez@redhat.com>
We already support reading and writing byte ranges using GET and PUT,
but this support is optimized for transferring complete images.
We need to improve random I/O APIs for integration with virt-v2v and for
backup vendors. This patch documents the existing, changed, and new APIs
to be introduced in 1.3.
Change-Id: I98fbc20e1c05ab9fe627d33034034a47e1740da8
Bug-Url: https://bugzilla.redhat.com/1560242
Signed-off-by: Nir Soffer <nsoffer@redhat.com>
