Skip to content

Commit

Permalink
retrain
Browse files Browse the repository at this point in the history
  • Loading branch information
@babenek
babenek committed Sep 6, 2024
1 parent 8cb8e84 commit 21c6163
Show file tree
Hide file tree
Showing 3 changed files with 27 additions and 25 deletions.
50 changes: 25 additions & 25 deletions .ci/benchmark.txt
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
META MD5 78cb5d3d6472d88c6f785225321626ea
DATA MD5 79ac8163a2132e6d6588718e81ced074
META MD5 d3bd08f52ca9bea45c8692a0aeedb9c8
DATA MD5 09f6499448aa616b009bc762466386c1
DATA: 16345596 interested lines. MARKUP: 62813 items
FileType FileNumber ValidLines Positives Negatives Templates
--------------- ------------ ------------ ----------- ----------- -----------
Expand Down Expand Up @@ -30,7 +30,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.cnf 8 858 15 36 16
.coffee 1 585 2
.conf 60 4945 55 64 53
.config 20 492 17 38 1
.config 20 492 15 40 1
.cpp 15 5688 2 61
.creds 1 10 1 1
.crlf 1 27 1
Expand Down Expand Up @@ -63,7 +63,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.gd 1 37 1
.gml 3 3075 16
.gni 3 5017 19
.go 1080 566476 694 4123 738
.go 1080 566476 695 4123 738
.golden 5 1168 1 13 29
.gradle 45 3265 4 90 100
.graphql 7 420 13
Expand All @@ -82,11 +82,11 @@ FileType FileNumber ValidLines Positives Negatives Templat
.ipynb 1 134 5
.j 1 241 4
.j2 30 5530 6 186 10
.java 621 134132 361 1366 170
.java 621 134132 361 1363 173
.jenkinsfile 1 58 2 6
.jinja2 1 64 2
.js 659 536413 536 2496 328
.json 851 13046493 1074 10910 140
.json 851 13046493 1075 10909 140
.jsp 13 3202 1 40
.jsx 7 857 19
.jwt 1 1 2
Expand Down Expand Up @@ -179,7 +179,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.scala 40 5071 22 101
.scss 16 8553 32 1
.secrets 1 11 1
.sh 143 21525 55 479 30
.sh 143 21525 54 480 30
.slim 1 153 1 2
.smali 1 775 18
.snap 3 1708 9 30 2
Expand All @@ -192,7 +192,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.sublime-keymap 1 3 1
.sum 37 22854 283
.svg 1 638 12
.t 9 1767 24 43 14
.t 9 1767 24 44 14
.td 2 14002 6
.template 19 1633 4 35 11
.test 2 24 25 4
Expand All @@ -209,7 +209,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.ts 583 106730 159 1800 201
.tsx 54 7914 1 114 5
.ttar 1 452 1
.txt 440 78102 5277 6368 49
.txt 440 78102 5279 6367 49
.utf8 1 77 2
.vsixmanifest 1 36 1
.vsmdi 1 6 2
Expand All @@ -223,27 +223,27 @@ FileType FileNumber ValidLines Positives Negatives Templat
.yml 419 36169 555 888 378
.zsh 6 872 12
.zsh-theme 1 97 1
TOTAL: 10264 16345596 12204 50509 5098
credsweeper result_cnt : 11482, lost_cnt : 0, true_cnt : 11234, false_cnt : 248
TOTAL: 10264 16345596 12205 50508 5101
credsweeper result_cnt : 11456, lost_cnt : 0, true_cnt : 11295, false_cnt : 161
Rules Positives Negatives Templates Reported TP FP TN FN FPR FNR ACC PRC RCL F1
------------------------------ ----------- ----------- ----------- ---------- ----- ---- ----- ---- -------- -------- -------- -------- -------- --------
API 129 3162 189 127 125 2 3349 4 0.000597 0.031008 0.998276 0.984252 0.968992 0.976562
API 129 3162 189 125 125 0 3351 4 0.000000 0.031008 0.998851 1.000000 0.968992 0.984252
AWS Client ID 168 21 0 160 160 0 21 8 0.000000 0.047619 0.957672 1.000000 0.952381 0.975610
AWS Multi 75 16 0 87 75 11 5 0 0.687500 0.000000 0.879121 0.872093 1.000000 0.931677
AWS S3 Bucket 66 24 0 92 66 24 0 0 1.000000 0.000000 0.733333 0.733333 1.000000 0.846154
AWS S3 Bucket 67 23 0 92 67 23 0 0 1.000000 0.000000 0.744444 0.744444 1.000000 0.853503
Atlassian Old PAT token 27 308 3 12 3 8 303 24 0.025723 0.888889 0.905325 0.272727 0.111111 0.157895
Auth 419 2739 76 391 386 5 2810 33 0.001776 0.078759 0.988250 0.987212 0.921241 0.953086
Auth 420 2738 77 390 387 3 2812 33 0.001066 0.078571 0.988872 0.992308 0.921429 0.955556
Azure Access Token 19 0 0 12 12 0 0 7 0.368421 0.631579 1.000000 0.631579 0.774194
BASE64 Private Key 7 4 0 7 7 0 4 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
BASE64 encoded PEM Private Key 7 0 0 5 5 0 0 2 0.285714 0.714286 1.000000 0.714286 0.833333
Bitbucket Client ID 143 2097 9 48 28 19 2087 115 0.009022 0.804196 0.940418 0.595745 0.195804 0.294737
Bitbucket Client Secret 301 809 10 40 29 11 808 272 0.013431 0.903654 0.747321 0.725000 0.096346 0.170088
CMD ConvertTo-SecureString 13 4 0 13 13 0 4 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
CMD Password 21 128 6 19 19 0 134 2 0.000000 0.095238 0.987097 1.000000 0.904762 0.950000
CMD Password 21 128 6 21 21 0 134 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
CMD Secret 1 1 0 1 1 0 1 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
CMD Token 6 0 0 6 6 0 0 0 0.000000 1.000000 1.000000 1.000000 1.000000
Certificate 23 471 1 23 17 6 466 6 0.012712 0.260870 0.975758 0.739130 0.739130 0.739130
Credential 95 420 74 92 91 1 493 4 0.002024 0.042105 0.991511 0.989130 0.957895 0.973262
Certificate 23 471 1 19 19 0 472 4 0.000000 0.173913 0.991919 1.000000 0.826087 0.904762
Credential 95 420 74 93 93 0 494 2 0.000000 0.021053 0.996604 1.000000 0.978947 0.989362
Docker Swarm Token 2 0 0 1 1 0 0 1 0.500000 0.500000 1.000000 0.500000 0.666667
Dropbox App secret 64 139 1 46 35 10 130 29 0.071429 0.453125 0.808824 0.777778 0.546875 0.642202
Facebook Access Token 0 1 0 0 0 1 0 0.000000 1.000000
Expand All @@ -258,17 +258,17 @@ Grafana Provisioned API Key 22 1 0
JSON Web Token 170 61 0 131 131 0 61 39 0.000000 0.229412 0.831169 1.000000 0.770588 0.870432
Jira / Confluence PAT token 0 4 0 0 0 4 0 0.000000 1.000000
Jira 2FA 15 6 1 12 12 0 7 3 0.000000 0.200000 0.863636 1.000000 0.800000 0.888889
Key 3908 15720 482 3963 3877 86 16116 31 0.005308 0.007932 0.994182 0.978299 0.992068 0.985135
Nonce 91 49 0 89 89 0 49 2 0.000000 0.021978 0.985714 1.000000 0.978022 0.988889
Key 3907 15721 482 3917 3892 25 16178 15 0.001543 0.003839 0.998011 0.993618 0.996161 0.994888
Nonce 91 49 0 90 90 0 49 1 0.000000 0.010989 0.992857 1.000000 0.989011 0.994475
Other 0 8291 1 0 0 8292 0 0.000000 1.000000
PEM Private Key 1019 1483 0 1023 1019 4 1479 0 0.002697 0.000000 0.998401 0.996090 1.000000 0.998041
Password 1854 7537 2698 1746 1710 36 10199 144 0.003517 0.077670 0.985110 0.979381 0.922330 0.950000
Salt 45 76 2 43 43 0 78 2 0.000000 0.044444 0.983740 1.000000 0.955556 0.977273
Secret 1300 1576 798 1279 1278 1 2373 22 0.000421 0.016923 0.993740 0.999218 0.983077 0.991082
Password 1853 7538 2698 1765 1736 29 10207 117 0.002833 0.063141 0.987923 0.983569 0.936859 0.959646
Salt 47 76 2 43 43 0 78 4 0.000000 0.085106 0.968000 1.000000 0.914894 0.955556
Secret 1300 1575 799 1286 1285 1 2373 15 0.000421 0.011538 0.995645 0.999222 0.988462 0.993813
Seed 1 6 0 0 0 6 1 0.000000 1.000000 0.857143 0.000000
Slack Token 4 1 0 4 4 0 1 0 0.000000 0.000000 1.000000 1.000000 1.000000 1.000000
Token 652 4171 438 623 618 5 4604 34 0.001085 0.052147 0.992587 0.991974 0.947853 0.969412
Token 651 4171 439 621 620 1 4609 31 0.000217 0.047619 0.993918 0.998390 0.952381 0.974843
Twilio API Key 0 5 2 0 0 7 0 0.000000 1.000000
URL Credentials 210 151 220 210 207 3 368 3 0.008086 0.014286 0.989673 0.985714 0.985714 0.985714
URL Credentials 210 151 220 209 209 0 371 1 0.000000 0.004762 0.998279 1.000000 0.995238 0.997613
UUID 1069 265 0 1068 1067 1 264 2 0.003774 0.001871 0.997751 0.999064 0.998129 0.998596
12204 50509 5098 11489 11234 248 50261 970 0.004910 0.079482 0.980578 0.978401 0.920518 0.948577
12205 50508 5101 11463 11295 161 50347 910 0.003188 0.074560 0.982922 0.985946 0.925440 0.954736
2 changes: 2 additions & 0 deletions credsweeper/ml_model/ml_config.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -373,11 +373,13 @@
".mk",
".ml",
".mlir",
".mod",
".moo",
".ndjson",
".nix",
".nolint",
".odd",
".oracle",
".pan",
".patch",
".php",
Expand Down
Binary file modified credsweeper/ml_model/ml_model.onnx
View file
Binary file not shown.

0 comments on commit 21c6163

Please sign in to comment.