Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider correct reputation amounts for different labels #6440

Open
ErikSchierboom opened this issue Jul 14, 2022 · 3 comments
Open

Consider correct reputation amounts for different labels #6440

ErikSchierboom opened this issue Jul 14, 2022 · 3 comments

Comments

@ErikSchierboom
Copy link
Member

As discussed in exercism/docs#347, the amount of reputation that we award for PRs/issues could perhaps use some fine-tuning. Getting these numbers right is very difficult, but it is worth the effort to see if the current values make sense.

As per the above-mentioned discussion, it seems that the large/massive PRs are likely the ones which might need some tweaking. As a starting point to get them right, lets examine the existing large and massive PRs:

Large

{gh search prs --limit 200 --label 'x:size/large' --json 'author,repository,title,url' --merged --jq '.[] | .repository.nameWithOwner + " | " + .title + " | " + .author.login + " | " + .url'; gh search prs --limit 200 --label 'x:rep/large' --json 'author,repository,title,url' --merged --jq '.[] | .repository.nameWithOwner + " | " + .title + " | " + .author.login + " | " + .url' } | sort -t\| -k1 | awk 'BEGIN{print "repo | title | author | url"; print "-- | -- | -- | --"}1'
repo title author url
exercism/awk-test-runner AWK test runner glennj exercism/awk-test-runner#1
exercism/c grade-school: align with specification per #503 wolf99 exercism/c#555
exercism/common-lisp Adding Practice Exercise Generator PaulT89 exercism/common-lisp#597
exercism/common-lisp Create format-basics concept & concept exercise. verdammelt exercism/common-lisp#537
exercism/csharp Implement new concept exercise for extension methods yzAlvin exercism/csharp#1585
exercism/csharp Upgrade projects to .NET 6 FaisalAfroz exercism/csharp#1811
exercism/csharp-analyzer Add analyzer for weighing-machine Grenkin1988 exercism/csharp-analyzer#109
exercism/csharp-test-runner Fix test runner failing for test classes with constructor ErikSchierboom exercism/csharp-test-runner#51
exercism/docs Fix links ErikSchierboom exercism/docs#200
exercism/elixir Bootstrap practice exercises jiegillet exercism/elixir#774
exercism/elixir New concept exercise city-office (docs and typespecs) angelikatyborska exercism/elixir#693
exercism/elixir New concept exercise dancing-dots (use and behaviour) angelikatyborska exercism/elixir#1103
exercism/elixir New concept exercise top-secret (concept: ast) angelikatyborska exercism/elixir#930
exercism/elixir New concept exercise: new-passport (concept: with) jiegillet exercism/elixir#954
exercism/elixir New concept exercise: take-a-number-deluxe (genserver) angelikatyborska exercism/elixir#1076
exercism/elixir New practice exercise food-chain jiegillet exercism/elixir#780
exercism/elixir New practice exercise killer-sudoku-helper jiegillet exercism/elixir#1116
exercism/elixir New practice exercise resistor-color-duo jiegillet exercism/elixir#800
exercism/elixir New practice exercise resistor-color-trio jiegillet exercism/elixir#801
exercism/elixir New practice exercise rest-api jiegillet exercism/elixir#831
exercism/elixir New practice exercise sgf-parsing jiegillet exercism/elixir#795
exercism/elixir New practice exercise square-root jiegillet exercism/elixir#797
exercism/elixir New practice exercise state-of-tic-tac-toe jiegillet exercism/elixir#1115
exercism/elixir New practice exercise variable-length-quantity jiegillet exercism/elixir#798
exercism/elixir Sync: re-write grade-school jiegillet exercism/elixir#1050
exercism/elixir Updates to test execution documentation czrpb exercism/elixir#940
exercism/elixir [#722] New practice exercise yacht elibdev exercism/elixir#760
exercism/elixir [#723] New practice exercise zebra-puzzle jiegillet exercism/elixir#753
exercism/elixir [#724] New practice exercise rational-numbers jiegillet exercism/elixir#755
exercism/elixir [#725] New practice exercise pov jiegillet exercism/elixir#752
exercism/elixir [#726] New practice exercise satellite jiegillet exercism/elixir#756
exercism/elixir [#763] New practice exercise affine-cipher jiegillet exercism/elixir#773
exercism/elixir [#764] New practice exercise book-store jiegillet exercism/elixir#778
exercism/elixir [#765] New practice exercise complex-numbers jiegillet exercism/elixir#769
exercism/elixir [#766] New practice exercise circular-buffer jiegillet exercism/elixir#775
exercism/elixir [#767] New practice exercise darts jiegillet exercism/elixir#777
exercism/elixir [#768] New practice exercise go-counting jiegillet exercism/elixir#776
exercism/elixir [#792] New practice exercise two-bucket jiegillet exercism/elixir#808
exercism/elixir [#793] New practice exercise word-search jiegillet exercism/elixir#804
exercism/elixir-analyzer 100% test coverage jiegillet exercism/elixir-analyzer#246
exercism/elixir-analyzer Add a common check for @doc + @spec order joseemds exercism/elixir-analyzer#185
exercism/elixir-analyzer Add a common check for boolean function naming patterns jiegillet exercism/elixir-analyzer#180
exercism/elixir-analyzer Add new check_source check to check source code as a string jiegillet exercism/elixir-analyzer#189
exercism/elixir-analyzer Allow reading multiple file solutions and exemploids jiegillet exercism/elixir-analyzer#298
exercism/elixir-analyzer New analyzer function: assert_call neenjaw exercism/elixir-analyzer#49
exercism/elixir-analyzer New common check: Helper functions should be private jiegillet exercism/elixir-analyzer#207
exercism/elixir-analyzer [#78] Write a basic square-root analysis jiegillet exercism/elixir-analyzer#112
exercism/elixir-representer Normalize types, typespecs and module attributes jiegillet exercism/elixir-representer#52
exercism/elixir-representer Normalizing multi-component modules and module aliases jiegillet exercism/elixir-representer#44
exercism/elm Add Custom types concept and associated exercise ceddlyburge exercism/elm#368
exercism/elm Add concept exercise for booleans mpizenberg exercism/elm#331
exercism/elm Add list concept and associated exercise ceddlyburge exercism/elm#365
exercism/elm Add record types concept and associated exercise ceddlyburge exercism/elm#369
exercism/elm Add task ID tags to concept exercise tests jiegillet exercism/elm#476
exercism/elm Basics-2 concept and associated exercise ceddlyburge exercism/elm#329
exercism/elm Concept maybe mpizenberg exercism/elm#361
exercism/elm New practice exercise: complex-numbers jiegillet exercism/elm#482
exercism/elm Tuples concept and associated exercise ceddlyburge exercism/elm#395
exercism/elm-test-runner Update elm-test-rs to v2.0 and add smoke tests jiegillet exercism/elm-test-runner#36
exercism/erlang-test-runner fully comply to version 2 spec NobbZ exercism/erlang-test-runner#22
exercism/fsharp Implement new Concept Exercise: tuples Grenkin1988 exercism/fsharp#1009
exercism/go zero_zilch_nada: remove ambiguous reference to empty sudomateo exercism/go#1500
exercism/go Add gomod-sync andrerfcsantos exercism/go#1954
exercism/go Add pointer concept andrerfcsantos exercism/go#1724
exercism/go Add welcome-to-tech-palace exercise ErikSchierboom exercism/go#1680
exercism/go Added new practice exercise: state-of-tic-tac-toe AbhilashJN exercism/go#2284
exercism/go Concept stringers with exercise norbs57 exercism/go#2208
exercism/go Functions concept bobtfish exercism/go#1720
exercism/go Implement new concept with exercise: randomness norbs57 exercism/go#2139
exercism/go New concept First-Class Functions antklim exercism/go#2103
exercism/go Regular expression concept with exercise norbs57 exercism/go#2159
exercism/go Update of testcase generator to latest JSON format eklatzer exercism/go#2279
exercism/go sorting-room: Implement exercise to teach about type-conversion and type-assertion jmrunkle exercism/go#1723
exercism/go bird-watcher: add "for loop" concept sachinmk27 exercism/go#1775
exercism/go interest-is-interesting: add exercise ErikSchierboom exercism/go#1740
exercism/go logs-logs-logs: update concept and exercise content sudomateo exercism/go#1707
exercism/go-representer Implement representer tehsphinx exercism/go-representer#15
exercism/groovy-test-runner Switch to Maven andreaTP exercism/groovy-test-runner#18
exercism/java Implement Connect Exercise kkyb123 exercism/java#2027
exercism/java-test-runner Switch to Maven on infrastructure andreaTP exercism/java-test-runner#39
exercism/javascript ✨ Add new exercise : Affine Cipher TomPradat exercism/javascript#887
exercism/javascript Add Concept Exercise: For Loops junedev exercism/javascript#1059
exercism/javascript Add Concept Exercise: Windowing System (Classes) junedev exercism/javascript#1476
exercism/javascript Add concept exercise conditionals junedev exercism/javascript#1037
exercism/javascript Add concept exercise functions junedev exercism/javascript#1183
exercism/javascript Add concept exercise objects junedev exercism/javascript#1160
exercism/javascript Add exercise: resistor-color SleeplessByte exercism/javascript#648
exercism/javascript Add new concept exercise : errors TomPradat exercism/javascript#978
exercism/javascript Add new exercise grep TomPradat exercism/javascript#752
exercism/javascript Add new exercise: resistor-color-trio SleeplessByte exercism/javascript#725
exercism/javascript Add ozans playlist concept exercise kristinaborn exercism/javascript#1093
exercism/javascript Add prerequisites for practice exercises TomPradat exercism/javascript#1030
exercism/javascript Add solution and spec files for elyses-transformative-enchantments SleeplessByte exercism/javascript#997
exercism/javascript Concept exercise: Template string and Ternary pertrai1 exercism/javascript#1428
exercism/javascript Implement D&D Character Exercise Tyresius92 exercism/javascript#676
exercism/javascript Implement resistor-colors exercise tejasbubane exercism/javascript#642
exercism/javascript Improve Concept Exercise Poetry Door Club Policy (strings) junedev exercism/javascript#1342
exercism/javascript Improve Concept Exercise: Type Conversion junedev exercism/javascript#1248
exercism/javascript Improve concept exercise: Null and Undefined junedev exercism/javascript#1170
exercism/javascript Linting overhaul SleeplessByte exercism/javascript#1094
exercism/javascript New Exercise: Promises slaymance exercism/javascript#932
exercism/javascript Port Yacht exercise ovidiu141 exercism/javascript#799
exercism/javascript Sync all exercises SleeplessByte exercism/javascript#895
exercism/javascript Update Fruit Picker -- remove conceptual leaps neenjaw exercism/javascript#1725
exercism/javascript Update concept exercises to pass the linter SleeplessByte exercism/javascript#999
exercism/javascript Update sync and checksum script SleeplessByte exercism/javascript#1000
exercism/javascript [V3] Add Concept Exercise: While and Switch junedev exercism/javascript#1073
exercism/javascript [V3] Annalyn's Infiltration: fix everything around this exercise SleeplessByte exercism/javascript#1020
exercism/javascript [V3] Elyses Enchantments: fix everything around this exercise SleeplessByte exercism/javascript#1071
exercism/javascript [V3] Elyses Looping Enchantments: fix everything around this exercise SleeplessByte exercism/javascript#1097
exercism/javascript [V3] Freelancer Rates: fix everything around this exercise SleeplessByte exercism/javascript#1021
exercism/javascript [V3] Lucian's Lucious Lasagna: fix everything around this exercise SleeplessByte exercism/javascript#1018
exercism/javascript [V3] Poetry Club Door Policy: fix everything around this exercise SleeplessByte exercism/javascript#1043
exercism/javascript [V3] Translation Service: fix everything around this exercise #1071 SleeplessByte exercism/javascript#1096
exercism/javascript add scale-generator exercise seeksort exercism/javascript#754
exercism/javascript-test-runner Allow skipping tests SleeplessByte exercism/javascript-test-runner#62
exercism/javascript-test-runner Initial files alirezaghey exercism/javascript-test-runner#1
exercism/javascript-test-runner Release version 2.0 SleeplessByte exercism/javascript-test-runner#26
exercism/javascript-test-runner Update test runner with console output SleeplessByte exercism/javascript-test-runner#29
exercism/kotlin Update Kotlin and Gradle incendium exercism/kotlin#505
exercism/lua-test-runner lua-test-runner version 2 implemention imolein exercism/lua-test-runner#41
exercism/nim-test-runner Fix per test escaping ynfle exercism/nim-test-runner#108
exercism/php Provide stubs codedge exercism/php#357
exercism/python Add Sets Concept Documents BethanyG exercism/python#2476
exercism/python Changed Names of Test Classes to be ExerciseNameTest BethanyG exercism/python#2603
exercism/python Clean up on the List and List-Method Isles BethanyG exercism/python#2404
exercism/python Concept Conditionals Add Files BethanyG exercism/python#2430
exercism/python Concept Exercise Roadmap Updates BethanyG exercism/python#2805
exercism/python Concept and Practice Exercise Mapping BethanyG exercism/python#2383
exercism/python Fix "Making the Grade" ('Loops`) Concept Exercise BethanyG exercism/python#2407
exercism/python Fix error_case test gen to check for 'score' prpty rneilsen exercism/python#2840
exercism/python Fixed Template Error, regenerated tests for Flattened Problem Specs BethanyG exercism/python#2421
exercism/python Gracefully fail with user-friendly error text when unrecognized datac… cmccandless exercism/python#2427
exercism/python Improve test spacing in chaitanas-colossal-coaster pranasziaukas exercism/python#2659
exercism/python Issue 2953 (and issue 2745) Revise Track Documentation BethanyG exercism/python#2989
exercism/python Loops spiffying BethanyG exercism/python#2406
exercism/python Meltdown exercise change according to issue #2565 kbuc exercism/python#2568
exercism/python Practice exercise prerequisites & practices tags BethanyG exercism/python#2377
exercism/python Reconstituted V3 Repo PR2949 (exercism/v3#2949) BethanyG exercism/python#2420
exercism/python Redo elyses-enchantments/lists.py as card-games IsaacG exercism/python#2405
exercism/python Sets Concept Exercise BethanyG exercism/python#2485
exercism/python Strings Concept Exercise Re-Write BethanyG exercism/python#2433
exercism/python Update track tooling for v3 structure changes cmccandless exercism/python#2311
exercism/python [Black Jack]: Comparisons Concept and Concept Exercise Finalization BethanyG exercism/python#2844
exercism/python [Cater-Waiter]: Reduced the Overall Number of Set Tests to 82 BethanyG exercism/python#2615
exercism/python [Inventory Management] Typo & Language Edits for dicts Concept and Exercise. BethanyG exercism/python#2530
exercism/python [Linting]: Lint practice stub files (1 / ?) J08K exercism/python#2787
exercism/python [Linting]: Lint practice stub files (2 / ?) J08K exercism/python#2789
exercism/python [Linting]: Lint practice stub files (4 / ?) J08K exercism/python#2791
exercism/python [Linting]: Lint practice stub files (5 / ?) J08K exercism/python#2792
exercism/python [Linting]: Lint practice stub files (8 / 8) J08K exercism/python#2809
exercism/python [New Concept Exercise] : Generators (Plane Tickets) J08K exercism/python#2729
exercism/python [New Concept]: Decorators mathstrains21 exercism/python#2838
exercism/python [New Concept]: Recursion bobahop exercism/python#3051
exercism/python [New Workflow] Bot to automatically reply to new issues J08K exercism/python#2684
exercism/python [New Workflow] PR-Commenter Part 1/2 J08K exercism/python#2708
exercism/python [New Workflow]: Added snippets to the auto-pr-commenter. 2/2 BethanyG exercism/python#2707
exercism/python [New classes concept exercise]: ellens-alien-game PaulT89 exercism/python#2876
exercism/python [PR2429 Reconstruction] BethanyG exercism/python#2443
exercism/python [Practice Exercises]: Add Better Error Handling Instructions & Tests for Error Raising Messages (# 6 of 8) BethanyG exercism/python#2725
exercism/python [Practice Exercises]: Add Better Error Handling Instructions & Tests for Error Raising Messages (# 8 of 8) BethanyG exercism/python#2734
exercism/python [Simple Linked List]: Added instruction append and hints BethanyG exercism/python#3026
exercism/python [Update Concept] functions, and complete function arguments bobahop exercism/python#3067
exercism/python [class-inheritance] Concept Documentation girijakar exercism/python#2960
exercism/python-analyzer Issue 20: Exercise Names + A Refactor to Bring Into Spec Compliance BethanyG exercism/python-analyzer#22
exercism/ruby-test-runner Update Ruby to 3.0.2 katrinleinweber exercism/ruby-test-runner#48
exercism/scala-test-runner Compile exercises directly with scalac instead of sbt jcranky exercism/scala-test-runner#31
exercism/scheme New test system guygastineau exercism/scheme#262
exercism/swift Run concept exercises in CI sanderploegsma exercism/swift#487
exercism/swift-test-runner Fix test runner 2Grey exercism/swift-test-runner#22
exercism/typescript Add proofs and stubs for all practice exercises SleeplessByte exercism/typescript#443
exercism/typescript Exercise/resistor color trio rodmagaldi exercism/typescript#814
exercism/typescript New exercise ✨: DnD Character joshiraez exercism/typescript#479
exercism/typescript New exercise ✨: Knapsack joshiraez exercism/typescript#478
exercism/typescript Pass all the linting SleeplessByte exercism/typescript#453
exercism/typescript Update all GHA workflows SleeplessByte exercism/typescript#447
exercism/typescript Upgrade sync script SleeplessByte exercism/typescript#444
exercism/typescript-analyzer Update for v3 spec SleeplessByte exercism/typescript-analyzer#18
exercism/website Add progress svg graph to website journey and track show page. neenjaw exercism/website#1181
exercism/website Update progress graph line algorithm neenjaw exercism/website#1239
exercism/x86-64-assembly add collatz conjecture exercise sudhackar exercism/x86-64-assembly#146

Massive

{gh search prs --limit 200 --label 'x:size/massive' --json 'author,repository,title,url' --merged --jq '.[] | .repository.nameWithOwner + " | " + .title + " | " + .author.login + " | " + .url'; gh search prs --limit 200 --label 'x:rep/massive' --json 'author,repository,title,url' --merged --jq '.[] | .repository.nameWithOwner + " | " + .title + " | " + .author.login + " | " + .url' } | sort -t\| -k1 | awk 'BEGIN{print "repo | title | author | url"; print "-- | -- | -- | --"}1'
repo title author url
exercism/elm Create a practice exercise generator jiegillet exercism/elm#480
exercism/elm-analyzer Add docker integration, CI, and internal elm-review jiegillet exercism/elm-analyzer#27
exercism/elm-analyzer Proposal for Elm Analyzer jiegillet exercism/elm-analyzer#12
exercism/emacs-lisp-test-runner Upgrade to version 2 spec yshym exercism/emacs-lisp-test-runner#31
exercism/eslint-config-javascript Bump dependencies and add prettier SleeplessByte exercism/eslint-config-javascript#7
exercism/eslint-config-javascript Remove guard-for-in SleeplessByte exercism/eslint-config-javascript#1
exercism/eslint-config-tooling Add prettier SleeplessByte exercism/eslint-config-tooling#9
exercism/eslint-config-typescript Add prettier SleeplessByte exercism/eslint-config-typescript#6
exercism/haxe Add all concepts and fix CI midyHamdoun exercism/haxe#199
exercism/javascript-analyzer Design and apply a proper interface and structure SleeplessByte exercism/javascript-analyzer#18
exercism/javascript-analyzer Upgrade and use @exercism/static-analysis SleeplessByte exercism/javascript-analyzer#75
exercism/javascript-lib-static-analysis Add badges to readme SleeplessByte exercism/javascript-lib-static-analysis#30
exercism/javascript-lib-static-analysis Create LICENSE SleeplessByte exercism/javascript-lib-static-analysis#22
exercism/javascript-representer Add prettier SleeplessByte exercism/javascript-representer#30
exercism/javascript-test-runner Release version 2.0 SleeplessByte exercism/javascript-test-runner#26
exercism/javascript-test-runner Rewrite the test runner to work with Jest 27 SleeplessByte exercism/javascript-test-runner#68
exercism/javascript-test-runner Update interface and use @exercism/static-analysis SleeplessByte exercism/javascript-test-runner#31
exercism/julia-test-runner Collapse testsets cmcaine exercism/julia-test-runner#77
exercism/nim-representer Feature: upgrade macro evaluation strategy to use nimscripter ynfle exercism/nim-representer#37
exercism/python New contributing guidelines and README BethanyG exercism/python#2660
exercism/python [Maintenance]: Sync Practice Exercises from Problem Specification Repo BethanyG exercism/python#2914
exercism/python [Python Track Syllabus]: Track Re-Ordering BethanyG exercism/python#3057
exercism/python [TESTING.md] Enhance TESTING docs J08K exercism/python#2611
exercism/scala Bump Scala to version 2.13 and scalatest to version 3.2.10 CJSmith-0141 exercism/scala#712
exercism/tracks-maintenance-dashboard Add CI (install, build, test) SleeplessByte exercism/tracks-maintenance-dashboard#1
exercism/tracks-maintenance-dashboard Make it work with v3 repos SleeplessByte exercism/tracks-maintenance-dashboard#59
exercism/typescript Migrate to Jest 17, ESM, and config packages SleeplessByte exercism/typescript#944
exercism/typescript-analyzer Fix build and prepare step SleeplessByte exercism/typescript-analyzer#3
exercism/typescript-analyzer Sync with javascript analyzer SleeplessByte exercism/typescript-analyzer#2
exercism/typescript-representer Initial release based on the javascript-representer SleeplessByte exercism/typescript-representer#1
exercism/typescript-test-runner Migrate to Jest 17, and add support for task ID SleeplessByte exercism/typescript-test-runner#38
exercism/typescript-test-runner 👶🏽 hello there my sweet runner SleeplessByte exercism/typescript-test-runner#3
exercism/v3-dashboard Bump versions in CI to Node LTS SleeplessByte exercism/v3-dashboard#116
exercism/vbnet-test-runner Add initial version of test runner ErikSchierboom exercism/vbnet-test-runner#5
@SleeplessByte
Copy link
Member

Remember that this is a bad reflection of reality as we attached massive to get the rep that we were supposed to have for things that don't have PRs

@kotp
Copy link
Member

kotp commented Jul 14, 2022

Should we pin this for increased visibility temporarily?

@junedev
Copy link
Member

junedev commented Jul 17, 2022

What would help to sort this out would be if maintainers could leave a note on how many hours they roughly spent on the items above or anything else they would usually classify as large or massive.

@SleeplessByte The list is just for a rough impression of potential examples. The real question is the number of hours for the labels.

@kotp exercism/exercism is visited by a lot of non-maintainers that probably can't give input on this so I don't think pinning would help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants