Discussion:
Time ordered list of package builds
Kevin Oberman
2021-06-03 22:49:47 UTC
Permalink
When ports were in svn, the revision caused a listing of package builds to
be listed in order by default, but now git hashes are used and the order
seems effectively random. There is no column for start time and the
elapsed time column is blank.

Is there any simple way to look at the log of recent ports builds? Seeing
elapsed time would also be handy!
--
Kevin Oberman, Part time kid herder and retired Network Engineer
E-mail: ***@gmail.com
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683
Jan Beich
2021-06-04 02:58:22 UTC
Permalink
Post by Kevin Oberman
When ports were in svn, the revision caused a listing of package builds to
be listed in order by default, but now git hashes are used and the order
seems effectively random. There is no column for start time and the
elapsed time column is blank.
See also https://github.com/freebsd/poudriere/issues/865
Post by Kevin Oberman
Is there any simple way to look at the log of recent ports builds? Seeing
elapsed time would also be handy!
1. Open https://pkg-status.freebsd.org/?all=1&type=package
2. Enter 122amd64 int Search field
3. Click on Started (UTC) to sort
Kevin Oberman
2021-06-05 22:30:54 UTC
Permalink
Post by Jan Beich
Post by Kevin Oberman
When ports were in svn, the revision caused a listing of package builds
to
Post by Kevin Oberman
be listed in order by default, but now git hashes are used and the order
seems effectively random. There is no column for start time and the
elapsed time column is blank.
See also https://github.com/freebsd/poudriere/issues/865
Post by Kevin Oberman
Is there any simple way to look at the log of recent ports builds? Seeing
elapsed time would also be handy!
1. Open https://pkg-status.freebsd.org/?all=1&type=package
2. Enter 122amd64 int Search field
3. Click on Started (UTC) to sort
Thanks, Jan! That is exactly what I was looking for. I've spent a bit of
time poking around the pkg-status site but never stumbled onto this!
--
Kevin Oberman, Part time kid herder and retired Network Engineer
E-mail: ***@gmail.com
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683
Mark Millard via freebsd-ports
2021-06-04 03:05:40 UTC
Permalink
Kevin Oberman <rkoberman_at_gmail.com> wrote on
Post by Kevin Oberman
When ports were in svn, the revision caused a listing of package builds to
be listed in order by default, but now git hashes are used and the order
seems effectively random. There is no column for start time and the
elapsed time column is blank.
Is there any simple way to look at the log of recent ports builds? Seeing
elapsed time would also be handy!
(Note: I'm no fan of the choices in various places to use names that
are based on just the hash-ids, making the names not sort in a
generally useful order.)

There are multiple places giving different information about builds
and it is not clear to me just what you are referring to.

Taking one guess initially of a sequence that might get to an
example, something like:

http://beefy12.nyi.freebsd.org

From there I click on the main-armv7-default link and it shows
a list of builds with the problems described.

But it turns out one can sometimes first look up what
build name is of interest and so be able to pick out
the desired build at this point . . .

https://pkg-status.freebsd.org has a "Package Builds" section that
has a "Started (UTC) column that is filled in and can be sorted on.
The matching Search: field can be used with text like "main-" to
pick out builds targeting main [so: 14 now]. Similarly: "130releng-"
for picking out builds targeting 13.0 .

So I find that main-armv7 had a Tue, 20 Apr 2021 03:57:20 GMT
build start for 30978 queued ports and the port/system context for
this was:

pf43705587fa6_s14d0cd722

on beefy12.

Now, with that information do the prior sequence to get to the list
of builds and then click on the link for pf43705587fa6_s14d0cd722 .

That shows sections for Built ports, Failed ports, Skipped ports,
Ignored ports, and Queued ports. The Built and Failed sections
show elapsed times. There is also a Jobs section for in-progress
ports.

It appears that this sequence sometimes only works for builds that
made it to "stopped:done:" instead of "stopped:crashed:". There are
"stopped:crashed:" builds listed at:

http://beefy12.nyi.freebsd.org/jail.html?mastername=main-armv7-default

but https://pkg-status.freebsd.org did not show them. "Package Builds"
does list a few "stopped:crashed:" builds for other Jails. It does
not generally list builds that are still running in "parallel_build:"
status.

But the likes of (switching to a 130releng- example):

http://beefy12.nyi.freebsd.org/jail.html?mastername=130releng-armv7-quarterly

will indicate "parallel_build:" and will update the Built, Failed,
Skipped, Ignored, and Remaining figures periodically for builds that
are on-going. Again one can click through and see the detailed
status, including Elapsed times for specific ports.



===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Mark Millard via freebsd-ports
2021-06-04 03:40:12 UTC
Permalink
Post by Mark Millard via freebsd-ports
Kevin Oberman <rkoberman_at_gmail.com> wrote on
Post by Kevin Oberman
When ports were in svn, the revision caused a listing of package builds to
be listed in order by default, but now git hashes are used and the order
seems effectively random. There is no column for start time and the
elapsed time column is blank.
Is there any simple way to look at the log of recent ports builds? Seeing
elapsed time would also be handy!
(Note: I'm no fan of the choices in various places to use names that
are based on just the hash-ids, making the names not sort in a
generally useful order.)
There are multiple places giving different information about builds
and it is not clear to me just what you are referring to.
Taking one guess initially of a sequence that might get to an
http://beefy12.nyi.freebsd.org
From there I click on the main-armv7-default link and it shows
a list of builds with the problems described.
But it turns out one can sometimes first look up what
build name is of interest and so be able to pick out
the desired build at this point . . .
https://pkg-status.freebsd.org has a "Package Builds" section that
has a "Started (UTC) column that is filled in and can be sorted on.
The matching Search: field can be used with text like "main-" to
pick out builds targeting main [so: 14 now]. Similarly: "130releng-"
for picking out builds targeting 13.0 .
Using arm64 as an example, there is:

main-arm64
130arm64
130releng-arm64
122arm64

that show hash-id based Build names. "130releng-" prefixes
may be special to supporting the official release builds and
so not always the right thing to search for relative to 13.0 .

130releng-armv7 is more recent (2021-May-23 start) instead
of mid 2021-Apr . But it looks to be the first "130" on
https://pkg-status.freebsd.org with a hash-id based Build
name for armv7. That may mean it was special and that
130armv7 might be used later.
Post by Mark Millard via freebsd-ports
So I find that main-armv7 had a Tue, 20 Apr 2021 03:57:20 GMT
build start for 30978 queued ports and the port/system context for
pf43705587fa6_s14d0cd722
on beefy12.
Now, with that information do the prior sequence to get to the list
of builds and then click on the link for pf43705587fa6_s14d0cd722 .
That shows sections for Built ports, Failed ports, Skipped ports,
Ignored ports, and Queued ports. The Built and Failed sections
show elapsed times. There is also a Jobs section for in-progress
ports.
It appears that this sequence sometimes only works for builds that
made it to "stopped:done:" instead of "stopped:crashed:". There are
http://beefy12.nyi.freebsd.org/jail.html?mastername=main-armv7-default
but https://pkg-status.freebsd.org did not show them. "Package Builds"
does list a few "stopped:crashed:" builds for other Jails. It does
not generally list builds that are still running in "parallel_build:"
status.
http://beefy12.nyi.freebsd.org/jail.html?mastername=130releng-armv7-quarterly
will indicate "parallel_build:" and will update the Built, Failed,
Skipped, Ignored, and Remaining figures periodically for builds that
are on-going. Again one can click through and see the detailed
status, including Elapsed times for specific ports.
===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Kevin Oberman
2021-06-05 05:11:33 UTC
Permalink
Post by Mark Millard via freebsd-ports
Kevin Oberman <rkoberman_at_gmail.com> wrote on
Post by Kevin Oberman
When ports were in svn, the revision caused a listing of package builds
to
Post by Kevin Oberman
be listed in order by default, but now git hashes are used and the order
seems effectively random. There is no column for start time and the
elapsed time column is blank.
Is there any simple way to look at the log of recent ports builds? Seeing
elapsed time would also be handy!
(Note: I'm no fan of the choices in various places to use names that
are based on just the hash-ids, making the names not sort in a
generally useful order.)
There are multiple places giving different information about builds
and it is not clear to me just what you are referring to.
Taking one guess initially of a sequence that might get to an
http://beefy12.nyi.freebsd.org
From there I click on the main-armv7-default link and it shows
a list of builds with the problems described.
But it turns out one can sometimes first look up what
build name is of interest and so be able to pick out
the desired build at this point . . .
https://pkg-status.freebsd.org has a "Package Builds" section that
has a "Started (UTC) column that is filled in and can be sorted on.
The matching Search: field can be used with text like "main-" to
pick out builds targeting main [so: 14 now]. Similarly: "130releng-"
for picking out builds targeting 13.0 .
So I find that main-armv7 had a Tue, 20 Apr 2021 03:57:20 GMT
build start for 30978 queued ports and the port/system context for
pf43705587fa6_s14d0cd722
on beefy12.
Now, with that information do the prior sequence to get to the list
of builds and then click on the link for pf43705587fa6_s14d0cd722 .
That shows sections for Built ports, Failed ports, Skipped ports,
Ignored ports, and Queued ports. The Built and Failed sections
show elapsed times. There is also a Jobs section for in-progress
ports.
It appears that this sequence sometimes only works for builds that
made it to "stopped:done:" instead of "stopped:crashed:". There are
http://beefy12.nyi.freebsd.org/jail.html?mastername=main-armv7-default
but https://pkg-status.freebsd.org did not show them. "Package Builds"
does list a few "stopped:crashed:" builds for other Jails. It does
not generally list builds that are still running in "parallel_build:"
status.
http://beefy12.nyi.freebsd.org/jail.html?mastername=130releng-armv7-quarterly
will indicate "parallel_build:" and will update the Built, Failed,
Skipped, Ignored, and Remaining figures periodically for builds that
are on-going. Again one can click through and see the detailed
status, including Elapsed times for specific ports.
===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Sorry. I now see that I was unclear, but you seem to have figured it out.
I believe that I am aware of all of the things you mention but I can't find
a way to track back beyond the current build, the only one marked as
"parallel_build", and the prior build which is tagged "Latest build" in the
header and highlighted in yellow. If I want to look at the second latest, I
have no idea how I can find it.

If I look at the list for beey16 at
http://beefy16.nyi.freebsd.org/jail.html?mastername=130amd64-default, I get
a list of builds that include no clue as to ordering. No start time or any
way to look up a particular build unless I have recorded the hash while the
build was in progress.

Thanks for your reply, Mark.
--
Kevin Oberman, Part time kid herder and retired Network Engineer,
E-mail: ***@gmail.com
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683
Mark Millard via freebsd-ports
2021-06-05 06:06:46 UTC
Permalink
. . .
Sorry. I now see that I was unclear, but you seem to have figured it out. I believe that I am aware of all of the things you mention but I can't find a way to track back beyond the current build, the only one marked as "parallel_build", and the prior build which is tagged "Latest build" in the header and highlighted in yellow. If I want to look at the second latest, I have no idea how I can find it.
If I look at the list for beey16 at http://beefy16.nyi.freebsd.org/jail.html?mastername=130amd64-default, I get a list of builds that include no clue as to ordering. No start time or any way to look up a particular build unless I have recorded the hash while the build was in progress.
I did not realize that https://pkg-status.freebsd.org always
shows just the most recently completed build for the Ports Jail
combination.

Sorry for the noise.

Time frames can painfully be found by clicking through to each build's
detailed page and looking at a log file from some port that generated
one: the 2nd line of the log file is a "build started at" line.

But one probably needs to have a strong reason in order to put such an
effort in, especially as the list of builds grows.


Something like https://artifact.ci.freebsd.org/snapshot/stable-13/?C=M&O=D
appears to have dates, but one can find that the individual files have
much older dates than shown at the stable-13/* level. Also, at the
stable-13/* sort of level, one cannot tell which platforms have examples
available. That is 1 or 2 more levels down, depending on the platform.
Ultimately: another now-more-difficult-mess to deal with.

===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Jan Beich
2021-06-05 10:10:25 UTC
Permalink
Post by Mark Millard via freebsd-ports
Post by Mark Millard via freebsd-ports
. . .
Sorry. I now see that I was unclear, but you seem to have figured it
out. I believe that I am aware of all of the things you mention but
I can't find a way to track back beyond the current build, the only
one marked as "parallel_build", and the prior build which is tagged
"Latest build" in the header and highlighted in yellow. If I want to
look at the second latest, I have no idea how I can find it.
If I look at the list for beey16 at
http://beefy16.nyi.freebsd.org/jail.html?mastername=130amd64-default,
I get a list of builds that include no clue as to ordering. No start
time or any way to look up a particular build unless I have recorded
the hash while the build was in progress.
I did not realize that https://pkg-status.freebsd.org always
shows just the most recently completed build for the Ports Jail
combination.
Did you try to click on "View all" link at the top of the page?
Mark Millard via freebsd-ports
2021-06-05 10:56:53 UTC
Permalink
Post by Jan Beich
Post by Mark Millard via freebsd-ports
Post by Mark Millard via freebsd-ports
. . .
Sorry. I now see that I was unclear, but you seem to have figured it
out. I believe that I am aware of all of the things you mention but
I can't find a way to track back beyond the current build, the only
one marked as "parallel_build", and the prior build which is tagged
"Latest build" in the header and highlighted in yellow. If I want to
look at the second latest, I have no idea how I can find it.
If I look at the list for beey16 at
http://beefy16.nyi.freebsd.org/jail.html?mastername=130amd64-default,
I get a list of builds that include no clue as to ordering. No start
time or any way to look up a particular build unless I have recorded
the hash while the build was in progress.
I did not realize that https://pkg-status.freebsd.org always
shows just the most recently completed build for the Ports Jail
combination.
Did you try to click on "View all" link at the top of the page?
Thanks for that note. I've immediately scrolled down to
Package Builds section consistently, never noticing that
first line. Looks like it causes:

https://pkg-status.freebsd.org/?all=1

which could be used directly.

Looks like all 24 builds from:

http://beefy16.nyi.freebsd.org/jail.html?mastername=130amd64-default

are listed in the show all mode (after increasing "Show <?>
entries").

I found that if I first sort on Started (UTC) and then
change to sort on Ports, the sort is a stable sort and
the time order is preserved within the block of
"default"s that results. Thus I'm seeing a block of 24
"default" builds in most-recent to oldest order right
now. Elapsed times are shown. Queued, Built, Failed,
Skipped, Ingored, and Remaining counts are shown for
the overall build. The active "parallel_build:"s are
shown.

So my original instructions were just missing a couple
of steps I was ignorant of.

It does appear that getting to all the individual-port
information requires going to the Server and finding
the matching build there. Clicking on a Build link
in https://pkg-status.freebsd.org/?all=1 gets to
something focused on New Failed and New Skipped and
some overall summary information.

Thanks again.


===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Jan Beich
2021-06-05 11:09:32 UTC
Permalink
Post by Mark Millard via freebsd-ports
It does appear that getting to all the individual-port
information requires going to the Server and finding
the matching build there. Clicking on a Build link
in https://pkg-status.freebsd.org/?all=1 gets to
something focused on New Failed and New Skipped and
some overall summary information.
Try clicking on poudrière icon (smoking powder keg). Each line has two
such icons: one for jail (to check all builds) and one for a particular build.
Mark Millard via freebsd-ports
2021-06-05 11:22:08 UTC
Permalink
Post by Jan Beich
Post by Mark Millard via freebsd-ports
It does appear that getting to all the individual-port
information requires going to the Server and finding
the matching build there. Clicking on a Build link
in https://pkg-status.freebsd.org/?all=1 gets to
something focused on New Failed and New Skipped and
some overall summary information.
Try clicking on poudrière icon (smoking powder keg). Each line has two
such icons: one for jail (to check all builds) and one for a particular build.
Cool.

I see a 3rd such icon: it is next to the server name. So:

Poduriere Jail
Poudriere Build
Poudriere Server

views.

From what Kevin O. has said, I expect that he will use the
Poudriere Build icon. (As will I.)

Thanks again.

===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Kevin Oberman
2021-06-05 23:47:57 UTC
Permalink
Post by Mark Millard via freebsd-ports
Post by Mark Millard via freebsd-ports
It does appear that getting to all the individual-port
information requires going to the Server and finding
the matching build there. Clicking on a Build link
in https://pkg-status.freebsd.org/?all=1 gets to
something focused on New Failed and New Skipped and
some overall summary information.
Try clicking on poudriÚre icon (smoking powder keg). Each line has two
such icons: one for jail (to check all builds) and one for a particular
build.
Cool.
Poduriere Jail
Poudriere Build
Poudriere Server
views.
From what Kevin O. has said, I expect that he will use the
Poudriere Build icon. (As will I.)
Thanks again.
===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)
Thanks to both of you! Jan had the right answer and Mark asked the question
that I was still wondering about. It sent me to the "View all" button that
I never noticed since I always immediately scrolled down to "Package
Builds". (I also had sort of forgotten about the "Search" box.)

Many thanks, Jan! Maybe, if I get bored, I'll write a pkg-status "chest
sheet" or something similar and see about putting it on the wiki. No
promises, though! I seem to get round tuits pretty infrequently.
--
Kevin Oberman, Part time kid herder and retired Network Engineer
E-mail: ***@gmail.com
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683

Loading...