16 datasets, 2,000 messages each | Generated on $(date -u +"%Y-%m-%d %H:%M UTC")
npm warn exec The following package was not found and will be installed: tsx@4.23.1 drain-ts Benchmark Suite Running 16 dataset(s) against Loghub 2k ground truth... HDFS ... GA=0.9985 PTA=0.7624 31ms (16 clusters / 14 GT templates) Hadoop ... GA=0.9990 PTA=0.7978 29ms (102 clusters / 114 GT templates) Spark ... GA=1.0000 PTA=0.8976 17ms (33 clusters / 36 GT templates) OpenStack ... GA=0.9600 PTA=0.7309 19ms (72 clusters / 43 GT templates) Zookeeper ... GA=0.9985 PTA=0.8883 22ms (46 clusters / 50 GT templates) BGL ... GA=1.0000 PTA=0.8308 13ms (105 clusters / 120 GT templates) HPC ... GA=0.9980 PTA=0.8554 8ms (45 clusters / 46 GT templates) Thunderbird ... GA=0.9805 PTA=0.8339 15ms (179 clusters / 149 GT templates) Linux ... GA=1.0000 PTA=0.8545 16ms (111 clusters / 118 GT templates) Mac ... GA=0.9375 PTA=0.7937 24ms (296 clusters / 341 GT templates) Apache ... GA=1.0000 PTA=0.9211 12ms (6 clusters / 6 GT templates) OpenSSH ... GA=1.0000 PTA=0.8114 15ms (23 clusters / 27 GT templates) Windows ... GA=0.9980 PTA=0.8780 18ms (49 clusters / 50 GT templates) Android ... GA=0.9980 PTA=0.7174 22ms (149 clusters / 166 GT templates) HealthApp ... GA=1.0000 PTA=0.8794 11ms (72 clusters / 75 GT templates) Proxifier ... GA=0.9795 PTA=0.7750 24ms (8 clusters / 8 GT templates) ╔═══════════════╤══════════════════╤═══════╤═══════╤═══════╤═══════╤══════════╤══════════╗ ║ Dataset │ Category │ GA │ FGA │ PTA │ FTA │ GA Pass │ PTA Pass ║ ╟───────────────┼──────────────────┼───────┼───────┼───────┼───────┼──────────┼──────────╢ ║ HDFS │ Distributed Systems │ 0.9985 │ 0.9781 │ 0.7624 │ 0.7394 │ ✓ │ ✓ ║ ║ Hadoop │ Distributed Systems │ 0.9990 │ 0.9340 │ 0.7978 │ 0.8025 │ ✓ │ ✓ ║ ║ Spark │ Distributed Systems │ 1.0000 │ 0.9565 │ 0.8976 │ 0.8897 │ ✓ │ ✓ ║ ║ OpenStack │ Distributed Systems │ 0.9600 │ 0.8194 │ 0.7309 │ 0.7194 │ ✓ │ ✓ ║ ║ Zookeeper │ Distributed Systems │ 0.9985 │ 0.9338 │ 0.8883 │ 0.9022 │ ✓ │ ✓ ║ ║ BGL │ Supercomputers │ 1.0000 │ 0.9333 │ 0.8308 │ 0.8000 │ ✓ │ ✓ ║ ║ HPC │ Supercomputers │ 0.9980 │ 0.9328 │ 0.8554 │ 0.8593 │ ✓ │ ✓ ║ ║ Thunderbird │ Supercomputers │ 0.9805 │ 0.9629 │ 0.8339 │ 0.8452 │ ✓ │ ✓ ║ ║ Linux │ Operating Systems │ 1.0000 │ 0.9694 │ 0.8545 │ 0.8703 │ ✓ │ ✓ ║ ║ Mac │ Operating Systems │ 0.9375 │ 0.9123 │ 0.7937 │ 0.8079 │ ✓ │ ✓ ║ ║ Apache │ Server Applications │ 1.0000 │ 1.0000 │ 0.9211 │ 0.9028 │ ✓ │ ✓ ║ ║ OpenSSH │ Server Applications │ 1.0000 │ 0.9200 │ 0.8114 │ 0.8218 │ ✓ │ ✓ ║ ║ Windows │ Operating Systems │ 0.9980 │ 0.9352 │ 0.8780 │ 0.8895 │ ✓ │ ✓ ║ ║ Android │ Mobile Systems │ 0.9980 │ 0.9320 │ 0.7174 │ 0.7816 │ ✓ │ ✓ ║ ║ HealthApp │ Mobile Systems │ 1.0000 │ 0.9796 │ 0.8794 │ 0.8794 │ ✓ │ ✓ ║ ║ Proxifier │ Standalone Software │ 0.9795 │ 0.8551 │ 0.7750 │ 0.7813 │ ✓ │ ✓ ║ ╟───────────────┼──────────────────┼───────┼───────┼───────┼───────┼──────────┼──────────╢ ║ AVERAGE │ │ 0.9905 │ │ 0.8267 │ │ │ ║ ╚═══════════════╧══════════════════╧═══════╧═══════╧═══════╧═══════╧══════════╧══════════╝ Performance: HDFS : 31ms (63,880 logs/sec) Hadoop : 29ms (68,564 logs/sec) Spark : 17ms (117,860 logs/sec) OpenStack : 19ms (104,523 logs/sec) Zookeeper : 22ms (89,144 logs/sec) BGL : 13ms (157,546 logs/sec) HPC : 8ms (263,306 logs/sec) Thunderbird : 15ms (129,838 logs/sec) Linux : 16ms (127,487 logs/sec) Mac : 24ms (84,161 logs/sec) Apache : 12ms (172,475 logs/sec) OpenSSH : 15ms (132,610 logs/sec) Windows : 18ms (108,589 logs/sec) Android : 22ms (92,218 logs/sec) HealthApp : 11ms (177,703 logs/sec) Proxifier : 24ms (84,209 logs/sec) Overall Status: GA: ✅ ALL PASS PTA: ✅ ALL PASS Result: ✅ ALL TARGETS MET