13b37ddaa2
ostbuild: Allow specifying components to git fetch
2012-06-07 10:19:28 -04:00
210fbc3daf
ostbuild: Add rootdir argument to deploy-qemu
2012-06-06 15:43:42 -04:00
2c385c0078
ostbuild: Fix circular dependency between resolve and git-mirror
...
git-mirror was looking for the latest snapshot, which we don't
have until we resolve.
This leads to some code duplication.
2012-06-06 12:56:48 -04:00
a14ff0aeab
core: Fix mkdtemp invocation
2012-06-06 10:03:15 -04:00
c436f8ac61
ostbuild: Add -k option to git-mirror
...
libwacom's sourceforge git server was down...
2012-06-05 22:55:53 -04:00
e485bace01
pull: Download and checksum asynchronously
...
This is quite a noticeable speedup when downloading loose objects.
2012-06-05 22:38:17 -04:00
df54408e5d
core: Fix memory leak
2012-06-05 22:32:03 -04:00
8f2dda3e25
core: Just require libsoup, not libsoup-gnome
2012-05-31 10:25:41 -04:00
cbd4ade053
core: Switch to using mkdtemp() so we only depend on GLib 2.28
...
We claim to build against 2.28, let's actually make it work.
2012-05-29 22:34:11 -04:00
f438d9aaa6
core: Drop some dead temporary file code
2012-05-29 22:09:31 -04:00
90aff4f2f6
Trivial: fix a typo
2012-05-26 18:48:06 -04:00
d3b063cec0
ostbuild: Have resolve use git-mirror rather than duplicating code
...
This also brings us back to a sensible world of:
ostbuild resolve --fetch
Doing both fetch *and* writing out the updated revisions.
2012-05-26 12:10:51 -04:00
9582effb8d
core: Don't checkout symbolic links via hardlink
...
Doing so can easily get us up to the maximum ext4 hardlink count.
2012-05-26 11:55:12 -04:00
1ef6bb0ef6
ostbuild: add --diffstat option for source-diff
2012-05-25 15:01:41 -04:00
9c27f1de99
core: Remove leftover debug print
2012-05-25 09:55:10 -04:00
88b3440eef
core: ostree-pull: Add --depth option
...
This is useful for getting say the last 10 builds.
2012-05-24 20:58:20 -04:00
fb71519cd6
core: Attempt direct link() and fallback on EEXIST
...
Rather than always doing:
1) make temporary link
2) unlink() target
3) rename()
Just try making the link, and only do the second two if the file
already exists. This reduces system call traffic a lot.
2012-05-24 20:14:51 -04:00
f7bbf41132
ostbuild: Add 'tag' concept to manifest, improve git mirroring
...
We should explicitly distinguish between the case where we have a git
branch we're following, versus an immutable tag. In the latter case,
we can entirely avoid running 'git fetch' for it once we have it.
This is a noticeable speedup in our current scenario of pinning WebKit
to a tag.
The git mirroring code now has a --fetch-skip-secs=X option which
allows us to basically run it in a loop, without hitting remote git
repositories too often.
2012-05-24 19:54:36 -04:00
0d1ba45c73
ostbuild: git-mirror: Also fetch patches git
2012-05-24 18:11:06 -04:00
1a5ea54aff
core: Make OstreeRepo struct private
2012-05-23 18:08:52 -04:00
6c006815ce
ostbuild: Fix --debug-shell option
2012-05-23 18:02:08 -04:00
893774aab5
core: Make device/inode loose object cache work for parent repos too
...
Otherwise ostbuild suddenly becomes significantly slower when using a
shadow repo.
2012-05-23 07:48:16 -04:00
b45a0803fe
ostbuild: Few more misc fixes
2012-05-22 08:26:17 -04:00
95f66e1157
ostbuild: Fix typos in component lookup path
2012-05-21 18:41:59 -04:00
9bd36f9bff
ostbuild: Enhance source-diff with --log and --logp options
2012-05-18 20:25:02 -04:00
6d59b4077c
ostbuild: Add source-diff builtin
...
OMG OMG OMG
2012-05-18 20:12:35 -04:00
58d28ad5a6
core: Rearrange code for clarity (doesn't actually fix leaks)
2012-05-18 20:12:17 -04:00
790d2757f6
ostbuild: Drop dead branch-prefix and pull-components
...
And other various tweaks.
2012-05-18 16:30:45 -04:00
32020e55c8
ostbuild: Various fixes, removal of dead code
2012-05-18 16:30:45 -04:00
ecfd9b2cf3
ostbuild: Remove /var from components
...
We expect them to create on demand.
2012-05-18 16:30:45 -04:00
a3246d590e
ostbuild: Fix git-mirror
2012-05-18 16:30:45 -04:00
bcab6748a5
ostbuild: Some work on qemu deployment
2012-05-18 16:30:45 -04:00
3a20f6a913
ostadmin: Update for new trees/ location of trees
2012-05-18 16:30:45 -04:00
6e2efc6134
ostbuild: Add import-tree
...
This is the new workflow:
$ ostbuild import-tree wip-gnome-menus-3.6
$ $EDITOR ~/build/ostbuild/snapshots/wip-gnome-menus-3.6-2012.1-abcd.json
$ ostbuild build
2012-05-18 16:30:45 -04:00
f4aba2a339
ostbuild: Tighten build process significantly
...
First, "resolve" now just picks git commits. We don't expand
config-opts and patches, nor do we generate tree contents. This makes
the generated files *much* more human editable.
Next, fold "build-components" and "compose" into just "build". One
never really wants to just build components. This lets us eliminate
binary snapshots as a concept; instead we always have a combination of
source snapshot and component/ refs.
2012-05-18 16:30:45 -04:00
92244c80cc
ostbuild: More work on partial builds
2012-05-18 16:30:44 -04:00
eae69513a7
ostbuild: Make partial builds work
...
If we have component-revisions in our source+binary snapshot, then
we can skip them.
2012-05-18 16:30:44 -04:00
5d0744ea29
ostbuild: Write out related objects on composes
2012-05-18 16:30:44 -04:00
829a760b56
ostbuild: Minor fixes
2012-05-18 16:30:44 -04:00
65165ff1df
ostbuild: Make binary snapshots an extension of source
...
This significantly simplifies things; we no longer need to retrieve
individual components via 'pull-components', etc.
2012-05-18 16:30:44 -04:00
4f95106cda
core: Prefer packed metadata
2012-05-18 16:30:44 -04:00
f95090095e
core: Map metadata from repository as trusted
...
ot_util_variant_map() assumed untrusted; add a boolean, and use it for
the repository internals.
2012-05-18 16:30:44 -04:00
cf53ed5cef
core: Limit recursion during traversal
...
The related objects commit introduced OSTREE_MAX_RECURSION; use it.
2012-05-18 16:30:44 -04:00
cd38cb1489
core: Add write-refs builtin
...
This will be used by import-tree to pipe refs to write.
2012-05-14 21:58:22 -04:00
d7a15b381e
core: Allow adding related objects to commits
...
This will be used to store the set of components.
2012-05-14 21:58:22 -04:00
50cc2356f4
core: Really fix saving variants with REPLACE_DESTINATION
2012-05-14 20:49:00 -04:00
6d9de91672
core: Make argument parsing more robust against "lt-ostree" name
...
When running uninstalled, we were parsing our argv[0] incorrectly.
2012-05-14 11:31:53 -04:00
102180c5f2
core: Replace pack superindex via rename() rather than truncating
...
This helps allow cloning repositories via "cp -al".
2012-05-14 11:22:18 -04:00
2fbf864251
core: Clarify error message
2012-05-14 11:22:18 -04:00
5a1a300892
ostree-pull: Avoid an uninitialized variable warning
2012-05-12 10:51:01 -04:00
225cebd5ef
core: fix a typo
...
ostree config had two 'set' subcommands, but no 'get'.
2012-05-12 10:50:53 -04:00
4fa14eb712
core: Don't look in packs if we found loose object
...
Unless the caller wants us to; which at present none do, but let's be
forward looking and add an option.
2012-05-12 10:46:25 -04:00
6fbe15fc05
ostbuild: Add ostree-revision in buildroots, bin-to-src
...
First, for binary snapshots we need to include the exact revision of
the architecture buildroot. To do that, introduce
"architecture-buildroots2".
Second, for bin-to-src, we'd like to allow "partial" builds. So while
we do expand everything to source, *also* include the binary
ostree-revision. This will allow building just one component, while
reusing the previously built binaries.
2012-05-10 14:29:23 -04:00
d1b23f0807
ostbuild: Fix pull-components
...
We need to pull the actual commits, not the refs.
2012-05-10 10:30:02 -04:00
488ce33795
pull: Use API to stage files with length
...
Not doing so at the moment triggers a bug in the staging path, and
it's more efficient anyways.
2012-05-10 10:29:26 -04:00
c6df0b0ae0
pull: Add --prefer-loose option
...
This is a hack...
2012-05-10 09:54:56 -04:00
efc2810f02
core: unpack: Add --keep-packs option
...
Matches the pack --keep-all-loose.
2012-05-10 09:47:24 -04:00
a04ef7ba10
core: Fix ostree-pull to be able to look up remotes in parent repo
...
We should probably add a generalized inheritance mechanism.
2012-05-10 08:50:37 -04:00
f33a2f9a08
core: pack: Keep loose objects which are referenced externally
...
By default, don't delete loose objects which have hard links. This
has the natural semantics that if you delete all the checkouts, you
probably want it packed.
Conversely, if it has a hard link, we do want further checkouts to
share storage, even if we pack in between them.
2012-05-09 23:20:36 -04:00
d8b97316d9
core: unpack: Actually delete no-longer-needed pack files
2012-05-09 23:19:54 -04:00
fdf05be216
ostbuild: resolve: Add --fetch-patches option
...
This is kind of lame, but...
2012-05-09 19:46:29 -04:00
7149530976
ostbuild: Allow using dirty-git: for patches too
2012-05-09 19:40:24 -04:00
92891e60ca
ostbuild: Use .lastfetch file per branch
...
This way we don't try to update gtk+ twice, once for gtk master and
once for gtk-2-22.
2012-05-09 19:36:46 -04:00
bd6bd0eed5
ostree-pull: Fix segfault by initializing pull_data earlier
...
In the case of not being able to check the repository or not being able
to parse command line arguments, attributes from "pull_data" would be used
with garbage in them. This patch makes initialization of the sctructure to
happen earlier so it is safe to use in those cases.
2012-05-09 14:10:23 -04:00
d9bc7e0acd
ostbuild: build-components: Ensure specifying components forces rebuild
2012-05-09 12:46:04 -04:00
d2da92be07
Move gnomeos/ to "gnome-ostree" module
...
Now that we're hopefully going to be changing the format less. The
layering here is now more clear, rather than having things entangled.
2012-05-09 09:29:27 -04:00
dfbf1f7ac6
ostadmin: Use /ostree for current working directory of checkouts
...
Otherwise we put them in the wrong place.
2012-05-08 10:21:38 -04:00
9179d1b27a
ostadmin: Make a /ostree/current symbolic link
2012-05-08 09:14:03 -04:00
18b6f5fd0c
ostadmin: Initial code
2012-05-07 20:43:03 -04:00
1de0cc238b
ostbuild: further fixes to pull-components
...
Call self.parse_config() so that all necessary directories are parsed.
Also don't call nonexistant self.parse_active_branch() and just use
self.active_branch since it's already have been initialized.
2012-05-07 17:54:04 -04:00
f487500e50
ostbuild: Default to (previous) --skip-built
...
For components specified on the command line, we now force a rebuild.
There's also a new option to skip if the git revision matches, but
metadata changed (useful for now to avoid cascading builds if you know
you don't need it).
2012-05-07 17:51:12 -04:00
2ca6f04265
ostbuild: make pull-components work
...
This builtin did not work for me. It did not initialize self.repo,
it used the nonexisting parse_active_branch function unconditionally,
and it did not actually find the list of components in contents.json.
This commit fixes all three of these issues.
2012-05-06 14:09:28 -04:00
ae0b4ac628
Fix a typo
2012-05-06 13:57:09 -04:00
07f67f3baf
ostree: avoid a segfault
...
When running ostree --repo=/ostree/repo without further arguments,
we end up calling strcmp with one argument being NULL.
2012-05-06 13:56:57 -04:00
4a03176489
checkout: Deal gracefully with bad input
...
I had a /ostree/gnomeos-3.4-i686-devel directory, and this caused
ostree --repo=repo checkout gnomeos-3.5-i686-devel
to segfault.
2012-05-06 09:23:49 -04:00
c0e73c9fa0
core: pack: Fix calculation of size of pack objects
...
In archive mode, due to the previous change, we're now only
looking at metadata size, which is clearly wrong.
2012-05-05 16:00:53 -04:00
a0ad28c16c
core: pull: Fix regression from memory leak fixes
2012-05-05 14:59:14 -04:00
38dd179017
core: Compile again on GLib 2.28
2012-05-05 11:45:19 -04:00
ba1c75c61b
ostbuild: Drop use of link cache, it's gone now
2012-05-05 09:54:42 -04:00
9aa9397e42
ostbuild: Create deploy-qemu subcommand
2012-05-04 16:16:16 -04:00
a2d937c2f0
triggers: Print name of each trigger we're running
2012-05-04 16:16:16 -04:00
5835bb72b4
ostbuild: Make --shell-on-failure flag to work
...
Fixes an issue which would cause ostbuild to fail to spawn the
debug shell and print a traceback instead.
2012-05-04 16:16:16 -04:00
0597a3f71c
ostbuild: More work on deploy commands
2012-05-04 16:16:16 -04:00
3a365521a8
ostbuild: Use --from-file for buildroot compose for easier debugging
2012-05-04 16:16:16 -04:00
8785fefda8
ostbuild: Rename shadow-repo-init -> init
2012-05-04 16:16:16 -04:00
851a9c2ce9
ostbuild: Checksum full component metadata for --skip-built
...
If we're using --skip-built, we really do want to rebuild if anything
changed (like the build dependency, configure arguments etc.)
2012-05-04 16:16:16 -04:00
29b230107e
ostbuild: Break out git-mirror from resolve
...
Other bits
2012-05-04 16:16:16 -04:00
986cd2172b
ostbuild: Use expanduser
2012-05-04 16:16:16 -04:00
938f4eaf44
ostbuild: Lots more
2012-05-04 16:16:16 -04:00
b845e0a2bb
ostbuild: Resolve takes --manifest arg
2012-05-04 16:16:16 -04:00
a6a8e00edf
ostbuild: Add tree-to-bin and bin-to-src
2012-05-04 16:16:16 -04:00
0e266d3f92
ostbuild: Fix DB saving with /tmp and builddir in different volumes
...
This fixes the case where /tmp resides in one volume, and the build
directory in a different one: by storing the temporary file in the
same directory as the target one, we avoid the case in which os.rename()
would cross file system boundaries.
Reviewed-by: Colin Walters <walters@verbum.org>
2012-05-04 16:16:16 -04:00
717cec46c3
ostbuild: Major rework
2012-05-04 16:16:16 -04:00
7280ce358d
ostbuild: Show ostbuild log messages in warningfilter again
2012-05-04 16:16:16 -04:00
d040b61d19
core: checkout: Add --from-file option too
...
Easier for debugging if we don't have to redirect stdin.
Conflicts:
src/ostree/ot-builtin-checkout.c
2012-05-04 16:15:20 -04:00
0660d9e5cf
core: Improve error message if we hit an unreadable file
2012-05-04 16:14:47 -04:00
26c484faed
core: Add a mutex to cache data structures in preparation for threading
...
Conflicts:
src/libostree/ostree-repo.c
2012-05-04 16:14:28 -04:00
6cdbedf4e6
core: pull-local: Be a bit more verbose, don't open objects we already have
2012-05-04 16:13:44 -04:00
ac38a7e1b1
core: Avoid checksumming hardlinks that point into repository
...
By default, when doing a commit, scan all of our loose objects and
build up a (device,inode) -> checksum hash. Then when we're doing a
commit, if we see a file with that (device,inode) pair, we can avoid
checksumming it.
2012-05-04 16:10:30 -04:00
0fc291b954
core: Drop --link-cache option, we do it by default now for archives
2012-05-04 16:10:30 -04:00
Colin Walters
Matthias Clasen
Adrian Perez
Carl-Anton Ingmarsson