Bug 206226

Summary: Flaky Test: media/track/track-in-band-metadata-display-order.html
Product: WebKit Reporter: WebKit Commit Bot <commit-queue>
Component: Tools / TestsAssignee: WebKit Commit Bot <commit-queue>
Status: REOPENED    
Severity: Normal CC: ap, jer.noble, Lawrence.j, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=206225
https://bugs.webkit.org/show_bug.cgi?id=211132
Bug Depends on:    
Bug Blocks: 50856    
Attachments:
Description Flags
Archive of layout-test-results from webkit-cq-03
none
Archive of layout-test-results from webkit-cq-03
none
Archive of layout-test-results from webkit-cq-02
none
Archive of layout-test-results from webkit-cq-02
none
Archive of layout-test-results from webkit-cq-03 none

WebKit Commit Bot
Reported 2020-01-14 04:43:08 PST
This is an automatically generated bug from the commit-queue. media/track/track-in-band-metadata-display-order.html has been flaky on the commit-queue. media/track/track-in-band-metadata-display-order.html was authored by jer.noble@apple.com. https://trac.webkit.org/browser/trunk/LayoutTests/media/track/track-in-band-metadata-display-order.html The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387642 [details] on bug 206127. Bot: webkit-cq-03 Port: <class 'webkitpy.common.config.ports.MacPort'> Platform: Mac OS X 10.14.6 The bots will update this with information from each new failure. If you believe this bug to be fixed or invalid, feel free to close. The bots will re-open if the flake re-occurs. If you would like to track this test fix with another bug, please close this bug as a duplicate. The bots will follow the duplicate chain when making future comments.
Attachments
Archive of layout-test-results from webkit-cq-03 (3.20 MB, application/zip)
2020-01-14 04:43 PST, WebKit Commit Bot 		no flags
Details
Archive of layout-test-results from webkit-cq-03 (3.14 MB, application/zip)
2020-01-15 10:22 PST, WebKit Commit Bot 		no flags
Details
Archive of layout-test-results from webkit-cq-02 (3.33 MB, application/zip)
2020-01-15 12:48 PST, WebKit Commit Bot 		no flags
Details
Archive of layout-test-results from webkit-cq-02 (4.96 MB, application/zip)
2020-01-15 14:47 PST, WebKit Commit Bot 		no flags
Details
Archive of layout-test-results from webkit-cq-03 (4.27 MB, application/zip)
2020-03-06 18:05 PST, WebKit Commit Bot 		no flags
Details
View All Add attachment proposed patch, testcase, etc.
WebKit Commit Bot
Comment 1 2020-01-14 04:43:10 PST
Created attachment 387645 [details] Archive of layout-test-results from webkit-cq-03
WebKit Commit Bot
Comment 2 2020-01-15 10:22:21 PST
The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387791 [details] on bug 206288. Bot: webkit-cq-03 Port: <class 'webkitpy.common.config.ports.MacPort'> Platform: Mac OS X 10.14.6
WebKit Commit Bot
Comment 3 2020-01-15 10:22:22 PST
Created attachment 387799 [details] Archive of layout-test-results from webkit-cq-03
WebKit Commit Bot
Comment 4 2020-01-15 12:48:44 PST
The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387653 [details] on bug 206230. Bot: webkit-cq-02 Port: <class 'webkitpy.common.config.ports.MacPort'> Platform: Mac OS X 10.14.6
WebKit Commit Bot
Comment 5 2020-01-15 12:48:44 PST
Created attachment 387826 [details] Archive of layout-test-results from webkit-cq-02
WebKit Commit Bot
Comment 6 2020-01-15 14:47:48 PST
The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 387817 [details] on bug 206305. Bot: webkit-cq-02 Port: <class 'webkitpy.common.config.ports.MacPort'> Platform: Mac OS X 10.14.6
WebKit Commit Bot
Comment 7 2020-01-15 14:47:50 PST
Created attachment 387850 [details] Archive of layout-test-results from webkit-cq-02
Alexey Proskuryakov
Comment 8 2020-01-15 22:26:20 PST
This test sometimes times out in post-commit testing, but doesn't fail in the same way. Given how frequent this is now on commit queue, we will almost certainly need to do something about it. @@ -15,7 +15,7 @@ RUN(metadataTrack.addCue(new DataCue(2.25, video.duration, "second data cue"))) RUN(video.currentTime = 3) EVENT(seeked) -EXPECTED (textTrackDisplayElement(video, "display", 0).textContent == 'I am later') OK -EXPECTED (textTrackDisplayElement(video, "display", 1).textContent == 'I am earlier') OK +No text track cue with display id '-webkit-media-text-track-display' is currently visible +No text track cue with display id '-webkit-media-text-track-display' is currently visible END OF TEST
Radar WebKit Bug Importer
Comment 9 2020-02-07 16:46:21 PST
<rdar://problem/59278855>
Ryan Haddad
Comment 10 2020-02-26 14:53:14 PST
Moving this to resolved / config changed as we still don't see it on trunk bots and CQ hasn't commented for a month.
WebKit Commit Bot
Comment 11 2020-03-06 18:05:50 PST
The commit-queue just saw media/track/track-in-band-metadata-display-order.html flake (text diff) while processing attachment 392734 [details] on bug 208691. Bot: webkit-cq-03 Port: <class 'webkitpy.common.config.ports.MacPort'> Platform: Mac OS X 10.14.6
WebKit Commit Bot
Comment 12 2020-03-06 18:05:51 PST
Created attachment 392824 [details] Archive of layout-test-results from webkit-cq-03
Jason Lawrence
Comment 14 2020-03-27 14:39:30 PDT
I am able to reproduce this issue with r259132 on Mojave with the command below. run-webkit-tests --debug -1 media/track/track-default-attribute.html media/track/track-in-band-metadata-display-order.html [2/2] media/track/track-in-band-metadata-display-order.html failed unexpectedly (text diff) Retrying 1 unexpected failure ... Running 1 DumpRenderTree. 1 test ran as expected, 1 didn't: Diff: r259132-1585332831_857aab2737af/layout-test-results/media/track/track-in-band-metadata-display-order-actual.txt @@ -15,7 +15,7 @@ RUN(metadataTrack.addCue(new DataCue(2.25, video.duration, "second data cue"))) RUN(video.currentTime = 3) EVENT(seeked) -EXPECTED (textTrackDisplayElement(video, "display", 0).textContent == 'I am later') OK -EXPECTED (textTrackDisplayElement(video, "display", 1).textContent == 'I am earlier') OK +No text track cue with display id '-webkit-media-text-track-display' is currently visible +No text track cue with display id '-webkit-media-text-track-display' is currently visible END OF TEST
Jason Lawrence
Comment 15 2020-03-27 14:58:56 PDT
I also fails on Catalina with r259121 using the command below. run-webkit-tests media/track/track-default-attribute.html media/track/track-in-band-metadata-display-order.html [2/2] media/track/track-in-band-metadata-display-order.html failed unexpectedly (text diff) Retrying 1 unexpected failure ... Running 1 WebKitTestRunner. 1 test ran as expected, 1 didn't:
Ryan Haddad
Comment 16 2020-03-31 08:40:47 PDT
Marked test as flaky in https://trac.webkit.org/changeset/259292/webkit
Jason Lawrence
Comment 17 2020-05-08 07:25:55 PDT
This issue appears to be resolved. I have removed the expectations here: https://trac.webkit.org/changeset/261380/webkit
Note You need to log in before you can comment on or make changes to this bug.