[Monotone-devel] date certs on net.venge.monotone

[Markus Wanner]

Hi,

as mentioned in other threads already, I'm currently analyzing date
certs and comparing them against the revision ancestry. The obvious
first test database includes all of "net.venge.monotone*" (and nothing
else). At the time of testing, it had 14156 revisions with 17737
relations between them stored in the table revision_ancestry. 32 of the
ancestry relations are initial revisions with the null_id as parent.

All revisions had at least one date cert. If there are multiple date
certs for the same revision, I've decided to counting the earliest date
for the revision.

Checking these dates against the revision ancestry reveals, that only 58
(0.33%) of all of these dependencies turn out to have inversed date
information (see [1] for a full list). For all of the remaining 17647
(99.67%) ancestory relations, the date information is plausible (i.e.
the timestamp of the date cert on the ancestor revision is lower than
that of the descendant revision) (Yes, this currently includes counting
dependent revisions with equal timestamps as invalid, which is certainly
bogus, just highly unlikely).

For Botan and Pidgin repositories it's pretty similar:

Botan: 3 of 1786 (0.17%)
Pidgin: 36 of 28349 (0.13%)

What surprised me about the pidgin repository is, that there are some
date certs with six digits (!) for milliseconds in the date, i.e.:
 "2006-11-01T21:39:36.807940"

Thus, I've added support for that format (without parsing the
milliseconds part, though) in nvm.dates.


OpenEmbedded (latest mtn snapshot) is slightly higher:
501 of 32686 (1.53%)

But what currently puzzles me is the Xaraya repository:
Xaraya: 6037 or 23413 (25%)

I didn't investigate further, but the time gaps are pretty large...
however, maybe choosing the earliest date just isn't clever enough.

Regards

Markus Wanner

[1]: full list of date mismatches:
> mtn: checking timestamps of ancestor revisions
> mtn:    rev 006972c572eb094a3c03d3ea6105e7f31f5bfa05 -> rev 
> c6bd5efd89266879cf9cbe7006b0fe5ca5d5b4dc
> mtn:    but date 2003-10-20T22:15:28 ! -> 2003-10-20T21:38:09
> mtn:    (difference: 2239 seconds)
> mtn:    rev 02ef37090f20abd12a6aba5cd0244ca78a05ab11 -> rev 
> a43b9f2bec32d4a63f073e414f067862d676f04c
> mtn:    but date 2004-05-03T00:48:36 ! -> 2004-05-03T00:05:41
> mtn:    (difference: 2575 seconds)
> mtn:    rev 05a0f9ce71013e8bc5c04c825a53d17a5e3007a9 -> rev 
> 3011908f7f234e48e5d90160cb406f02f09c19d2
> mtn:    but date 2007-09-02T05:29:33 ! -> 2007-09-02T03:35:35
> mtn:    (difference: 6838 seconds)
> mtn:    rev 05ee0ead1ba7806116bd8f887b8206790a2a7eec -> rev 
> 692d74c8ef9a112ba23ece0018daf82ad4382942
> mtn:    but date 2005-06-25T01:00:01 ! -> 2005-06-25T00:06:00
> mtn:    (difference: 3241 seconds)
> mtn:    rev 080864450f24829523bed008fbad268a6c7eb05c -> rev 
> b664839edf950807096ce987038b1d8ea0ebd0e9
> mtn:    but date 2004-08-09T17:21:34 ! -> 2004-08-05T23:09:44
> mtn:    (difference: 324710 seconds)
> mtn:    rev 0826abb7a5e5aacbcda1d3634178b718aada8378 -> rev 
> 00900acfa10d85988692ee7571028e7364afef79
> mtn:    but date 2005-07-24T02:09:56 ! -> 2005-07-23T23:30:22
> mtn:    (difference: 9574 seconds)
> mtn:    rev 087994568abcbf9aee0347356bad0e4af09152d2 -> rev 
> a9cd9f0a9d3d93dcd451ac49254d92603ec1272f
> mtn:    but date 2005-05-03T11:00:00 ! -> 2005-05-03T10:55:12
> mtn:    (difference: 288 seconds)
> mtn:    rev 13df407d1c24805c9a350dc49257c48a9ff3f2d4 -> rev 
> 91891a99890d2a9e497f3055f1f787d62d408d67
> mtn:    but date 2005-10-19T07:52:39 ! -> 2005-10-19T06:23:00
> mtn:    (difference: 5379 seconds)
> mtn:    rev 14312f90136babc24be6a746397f99b121e10353 -> rev 
> 650d4a285dbd92d434399202ec7fd3d412ba444d
> mtn:    but date 2005-11-21T01:18:57 ! -> 2005-11-21T00:53:23
> mtn:    (difference: 1534 seconds)
> mtn:    rev 14e42d73aa188b25687c93aecf799fc4b7b9f1e6 -> rev 
> f128c0fb1cd5bab53172c3fb443d3a7207182844
> mtn:    but date 2006-03-13T06:28:22 ! -> 2006-03-13T00:31:35
> mtn:    (difference: 21407 seconds)
> mtn:    rev 1ca6b8755c5fed18ca636aee06149963c0b2eef4 -> rev 
> 3e8a78b0f8151f58578134cad523b7c664229760
> mtn:    but date 2005-05-03T07:55:58 ! -> 2005-05-03T07:46:23
> mtn:    (difference: 575 seconds)
> mtn:    rev 1d11d03b9643ccf9305e332b598e59622231f998 -> rev 
> fa4cedc2a54a54225587fd0f788f63fa887cc6e9
> mtn:    but date 2006-08-06T09:04:46 ! -> 2006-08-06T08:57:07
> mtn:    (difference: 459 seconds)
> mtn:    rev 25609512782fe474133707a82d73349aa56f1f5c -> rev 
> 40bbc03627a68c9e4afd5fddd9fc9401e6e26b2f
> mtn:    but date 2007-12-16T17:10:30 ! -> 2007-12-16T17:08:30
> mtn:    (difference: 120 seconds)
> mtn:    rev 296d8fb7e07fbead3128638ca638e525e1ab38fc -> rev 
> 5c9e19109f4627ad83b51037afec5157e4be06ca
> mtn:    but date 2005-07-27T11:41:38 ! -> 2005-07-27T11:19:22
> mtn:    (difference: 1336 seconds)
> mtn:    rev 2b1e8f23addc3eb4aaf326f5632ce1e6fef5dad1 -> rev 
> 059e2e79d9de7a2a30a9a67947308df4cc970c62
> mtn:    but date 2005-07-14T00:44:41 ! -> 2005-07-13T23:58:09
> mtn:    (difference: 2792 seconds)
> mtn:    rev 2b9274ae48761b2ba80aaf59e7c69cbc3ebd8797 -> rev 
> c0e332e45cb38141df9fd2d9d6c129608697d65b
> mtn:    but date 2005-11-21T05:59:44 ! -> 2005-11-21T03:51:36
> mtn:    (difference: 7688 seconds)
> mtn:    rev 2d62628169132dcef669a00db3b504b583c206aa -> rev 
> f128c0fb1cd5bab53172c3fb443d3a7207182844
> mtn:    but date 2006-03-13T06:30:28 ! -> 2006-03-13T00:31:35
> mtn:    (difference: 21533 seconds)
> mtn:    rev 31caed6a8f360c527dcac00dafdde8c1b7e78c9a -> rev 
> 758e3ff95eb08141a0faf2a21077a9d944228784
> mtn:    but date 2005-11-25T08:23:33 ! -> 2005-11-25T05:35:34
> mtn:    (difference: 10079 seconds)
> mtn:    rev 42ed33a2dbad6ff2675bb3684d1d1eb7e71214c3 -> rev 
> 37615ce2fdfac798335c1d2e61e3b498f86e66ae
> mtn:    but date 2005-11-26T21:45:56 ! -> 2005-11-26T21:19:05
> mtn:    (difference: 1611 seconds)
> mtn:    rev 4911834d7e329a08ab266a7e587e6dc8581d99e9 -> rev 
> 369da8b74c4ad73e12eea5ca9a526b6ab0793885
> mtn:    but date 2005-10-04T05:44:45 ! -> 2005-10-04T04:22:42
> mtn:    (difference: 4923 seconds)
> mtn:    rev 4a94f35ddde4a8ab9754bdf659ae82b38ea890e9 -> rev 
> d6ebf3e37488e5e446940e3f7779d37658639ff7
> mtn:    but date 2005-12-14T08:12:57 ! -> 2005-12-14T06:17:21
> mtn:    (difference: 6936 seconds)
> mtn:    rev 4ce76c013d08458f7d5d6b67938f158c719e127f -> rev 
> 171b65f10e35e7ab2998f016f1db93b6fc953b6c
> mtn:    but date 2005-05-03T07:08:02 ! -> 2005-05-03T07:05:13
> mtn:    (difference: 169 seconds)
> mtn:    rev 63e135c36fc93a44bc251b998fce7115ce56f704 -> rev 
> e72b5f711d4385ee8a8d9e1809cbe95ebace9519
> mtn:    but date 2006-04-23T19:31:56 ! -> 2006-04-23T19:31:40
> mtn:    (difference: 16 seconds)
> mtn:    rev 655c15824587272f8d3aa4dff9922c53ec4ec92a -> rev 
> e1e1babf6761d8a728eb4cb7b2ba88e33fc5af54
> mtn:    but date 2005-06-22T08:16:42 ! -> 2005-06-22T07:33:22
> mtn:    (difference: 2600 seconds)
> mtn:    rev 6584a4d5f61dbfb35da7b3b86357c89561573e46 -> rev 
> 24f059148135f2a21ae0103ce9c9909f6cf52a05
> mtn:    but date 2005-10-19T09:02:33 ! -> 2005-10-19T06:23:33
> mtn:    (difference: 9540 seconds)
> mtn:    rev 686cbfea304bc57c87a944558b38b2680fc5a64b -> rev 
> fe92fa6c0e9e615d6c432a1bc4d2d8389c302d95
> mtn:    but date 2007-06-24T01:19:30 ! -> 2007-06-23T23:04:29
> mtn:    (difference: 8101 seconds)
> mtn:    rev 69bce850017f72060dea84d1b40b2ce1d9eda8a1 -> rev 
> dae03d5478c0bbbb03a7b8b27b02cebaec2d8641
> mtn:    but date 2007-04-20T09:48:18 ! -> 2007-04-20T09:31:16
> mtn:    (difference: 1022 seconds)
> mtn:    rev 6d8e0fb646d0fb0f1ce6116d93efb28d21891897 -> rev 
> 0304cff97ea6f587e28c7834dad0dff757ce62db
> mtn:    but date 2006-03-13T06:37:19 ! -> 2006-03-13T00:37:55
> mtn:    (difference: 21564 seconds)
> mtn:    rev 81df7bfbae10773341d4f0c50c0467bbdec35e0e -> rev 
> 56335008766d9011065e8ebf8f3f798a4317a5fe
> mtn:    but date 2005-07-15T04:20:27 ! -> 2005-06-22T21:30:19
> mtn:    (difference: 1925408 seconds)
> mtn:    rev 8384d2081128660fa8b0fa378df86c6b3519c057 -> rev 
> edfd28fd5c221e54efb9bd9c88dcfa60e84dcc2f
> mtn:    but date 2005-06-17T02:30:49 ! -> 2005-06-17T01:41:44
> mtn:    (difference: 2945 seconds)
> mtn:    rev 86cb7e167c0088642d346712b38768a454b8de02 -> rev 
> 81df7bfbae10773341d4f0c50c0467bbdec35e0e
> mtn:    but date 2005-07-15T05:11:25 ! -> 2005-07-15T04:20:27
> mtn:    (difference: 3058 seconds)
> mtn:    rev 8abf205ff767a00ea0e1db18b53c29411a63ccfc -> rev 
> 60b01148b9a680855f13f9ce60665e88622f6500
> mtn:    but date 2005-10-19T02:29:05 ! -> 2005-10-19T01:13:24
> mtn:    (difference: 4541 seconds)
> mtn:    rev 9070b401e26eec88e325d6150fe70de42ac0ac3c -> rev 
> 2766fb8acf690601e5ddaf3d75f59f47a85ca5de
> mtn:    but date 2005-08-17T09:31:50 ! -> 2005-08-17T08:29:57
> mtn:    (difference: 3713 seconds)
> mtn:    rev 92d3861530072aa734022201ac28ab76a39e83c5 -> rev 
> 3b22f38f07830fb7677440c3f4ecf556557084ee
> mtn:    but date 2007-03-26T12:27:39 ! -> 2007-03-26T11:37:11
> mtn:    (difference: 3028 seconds)
> mtn:    rev 9b75353aed15f0e90e15742d8fa754869cd981fb -> rev 
> ac69109e8cd46ceadc729c941695ef8541bda6a6
> mtn:    but date 2005-07-25T04:24:08 ! -> 2005-07-25T03:46:49
> mtn:    (difference: 2239 seconds)
> mtn:    rev 9c4e2869ac6d035b019772b61dad1946f510b479 -> rev 
> 22e8e2df0da1741f06d6aae14af06074c6606ef9
> mtn:    but date 2005-12-12T06:27:49 ! -> 2005-12-12T06:15:30
> mtn:    (difference: 739 seconds)
> mtn:    rev 9ca277d48bcc390f05ed16ecf88700578b262879 -> rev 
> af26667090001cebcd4aab9f7ab85c82df1b55bf
> mtn:    but date 2007-02-11T18:43:49 ! -> 2007-02-11T13:34:29
> mtn:    (difference: 18560 seconds)
> mtn:    rev a7d101433de57837fb6ebc5a6df290a9623b4692 -> rev 
> 61f5f31ff5429e9d4300d368685e9e5d2a91124b
> mtn:    but date 2006-12-21T12:35:36 ! -> 2006-12-21T11:48:04
> mtn:    (difference: 2852 seconds)
> mtn:    rev a8a6089ced980e25186b21b1e79eb0de8548e117 -> rev 
> 40484ff7a1c141fc00bfff79f9212cf5f4bf938f
> mtn:    but date 2007-02-11T21:45:11 ! -> 2007-02-11T14:08:28
> mtn:    (difference: 27403 seconds)
> mtn:    rev a9a8ecdeafda3da78a04023cc2535f3292ea359e -> rev 
> 291e24413afd3452708a4afa70a6264b1fabcb54
> mtn:    but date 2005-11-25T20:37:38 ! -> 2005-11-25T18:43:19
> mtn:    (difference: 6859 seconds)
> mtn:    rev aa7965192577caee57bf5d16431e19fccb6c83c3 -> rev 
> c8d3fd2f9a70aea2a6eed1f1657f330697bcc9ff
> mtn:    but date 2007-02-11T20:30:47 ! -> 2007-02-11T13:49:19
> mtn:    (difference: 24088 seconds)
> mtn:    rev aff4cf293f8326bde19d0c95073abe2949d0ce33 -> rev 
> b9d51992e2b0c34a5764ed4116e8a6d7e17e5995
> mtn:    but date 2005-07-16T21:26:26 ! -> 2005-07-16T21:17:03
> mtn:    (difference: 563 seconds)
> mtn:    rev bd50a8f1e8a4b2d1429f633169883eab04b106b9 -> rev 
> 56335008766d9011065e8ebf8f3f798a4317a5fe
> mtn:    but date 2005-07-15T09:31:19 ! -> 2005-06-22T21:30:19
> mtn:    (difference: 1944060 seconds)
> mtn:    rev beb8d70462751aa232f125134fcd74da2ec17e28 -> rev 
> d5383595f73b3f56844862cd140e3db3bae09ea0
> mtn:    but date 2005-11-21T05:14:25 ! -> 2005-11-21T03:51:09
> mtn:    (difference: 4996 seconds)
> mtn:    rev d2d4fe1af2667e1b59681ec8194d3d450ea18165 -> rev 
> eb6ad3f7799cfd6de1a40f178680a59aabaef233
> mtn:    but date 2005-08-09T07:54:55 ! -> 2005-08-09T07:36:22
> mtn:    (difference: 1113 seconds)
> mtn:    rev d74e8dcad786303f606d51f5a1fcb88fab97f15e -> rev 
> d5b19b11edc62bf274a64ea22a743f86eea4596c
> mtn:    but date 2005-07-12T00:07:58 ! -> 2005-07-12T00:01:07
> mtn:    (difference: 411 seconds)
> mtn:    rev d9ea66fbaa7745fa0d041dd84ed29286f00628e8 -> rev 
> d5842a131b5e1edb6906afe06458f3307d4be546
> mtn:    but date 2005-04-01T08:20:22 ! -> 2005-04-01T08:19:27
> mtn:    (difference: 55 seconds)
> mtn:    rev db3421b5ae411a694201c7bce5893542aab0d67d -> rev 
> 2282f6fdd9f5197817a5842e9d5571f1251c8b1c
> mtn:    but date 2005-10-10T02:06:14 ! -> 2005-10-09T23:27:52
> mtn:    (difference: 9502 seconds)
> mtn:    rev dd711020eee9e6acc45cae010478fbe3af4c75ed -> rev 
> d2c85495dba579c5ab125d7dbf3fa95568e9fd5f
> mtn:    but date 2007-02-11T19:37:33 ! -> 2007-02-11T13:38:25
> mtn:    (difference: 21548 seconds)
> mtn:    rev dfdfa2d272c5c1496f7015d06bbfae53ecd257a2 -> rev 
> ec3fe262a60d5031909e44b698b02fb594baebb0
> mtn:    but date 2005-12-23T08:21:35 ! -> 2005-12-23T05:45:50
> mtn:    (difference: 9345 seconds)
> mtn:    rev e76e981b217763967ca2fc13d455538251b9a529 -> rev 
> 5c11d39899eb98b31d31bee032762a06b829a75e
> mtn:    but date 2006-03-13T06:49:34 ! -> 2006-03-13T01:18:12
> mtn:    (difference: 19882 seconds)
> mtn:    rev ed1c7c1bf38f08dec0bf6ae4e8bbb5e331aacc0a -> rev 
> 24cc6fb620256494aca5b384a5646d499b45424d
> mtn:    but date 2007-06-15T00:36:43 ! -> 2007-06-15T00:36:40
> mtn:    (difference: 3 seconds)
> mtn:    rev ee15a2a4ea69e5a91d0211db8a418e94c8981690 -> rev 
> 10683b033e22e834be648308d1b289bdea105243
> mtn:    but date 2005-11-20T23:53:23 ! -> 2005-11-20T21:10:51
> mtn:    (difference: 9752 seconds)
> mtn:    rev ee293e066aa9e8222b7ce3b854affe49ddf9317c -> rev 
> 4dd538bd7bb906041b817b8bc6a93e87fb3759d5
> mtn:    but date 2008-04-30T15:32:06 ! -> 2008-04-30T15:32:06
> mtn:    (difference: 0 seconds)
> mtn:    rev f30f9fd74e903befde0d4e44476ababd5a79d8ba -> rev 
> 8e376153f3a7e2919b4544ce6c0ece2e70209d90
> mtn:    but date 2005-08-13T10:48:37 ! -> 2005-08-13T10:04:13
> mtn:    (difference: 2664 seconds)
> mtn:    rev fb7fd5a8a737003649fdfcace4d3edd0a0c5b1fc -> rev 
> 84074c06740f2dacb424153bc3a8720d473f71e8
> mtn:    but date 2006-04-02T22:47:07 ! -> 2006-04-02T22:38:21
> mtn:    (difference: 526 seconds)
> mtn:    rev ffb9c144a112c1af3ddbe63a55c19221c2d3d317 -> rev 
> ab479cf93cc30a3ac4f860cce4080302c22ecde0
> mtn:    but date 2006-11-06T11:51:15 ! -> 2006-11-06T11:19:59
> mtn:    (difference: 1876 seconds)
> mtn:    rev ffe281594b54c56a07829225d54c033807b13ae0 -> rev 
> c25a740d1adff4f5e48541704422138ef8f04d53
> mtn:    but date 2005-05-03T07:23:39 ! -> 2005-05-03T07:23:18
> mtn:    (difference: 21 seconds)