[OE-core] [PATCH] oeqa/concurrencytest: Optimise for autobuilder/clobberdir
richard.purdie at linuxfoundation.org
Thu Dec 5 11:30:02 UTC 2019
We're seeing huge delays on the autobuilder during oe-selftest builddir
deletion. For example there is a currently running selftest we could do
with the results from and its been going 13 hours, at least 8 of which
was in deletion of the builddirs.
There are a variety of ways we could solve this problem however the
autobuilder has a mechanism for deferred deletion, "clobberdir" which
it already uses for this kind of work.
Whilst in general hardcoding things like this is horrible, I believe
in this case the benefits (and resulting improvements on my sanity
if nothing else) mean this is a case where we should do it.
If/as/when someone can come up with a better solution that is fine
and this can be replaced.
Signed-off-by: Richard Purdie <richard.purdie at linuxfoundation.org>
meta/lib/oeqa/core/utils/concurrencytest.py | 9 +++++++++
1 file changed, 9 insertions(+)
diff --git a/meta/lib/oeqa/core/utils/concurrencytest.py b/meta/lib/oeqa/core/utils/concurrencytest.py
index 0f7b3dcc113..71ec0df5fad 100644
@@ -221,6 +221,15 @@ def removebuilddir(d):
while delay and os.path.exists(d + "/bitbake.lock"):
delay = delay - 1
+ # Deleting these directories takes a lot of time, use autobuilder
+ # clobberdir if its available
+ clobberdir = os.path.expanduser("~/yocto-autobuilder-helper/janitor/clobberdir")
+ if os.path.exists(clobberdir):
+ subprocess.check_call([clobberdir, d])
+ except subprocess.CalledProcessError:
def fork_for_tests(concurrency_num, suite):
More information about the Openembedded-core