2024.06.06

[seanmcilroy29]

---

2024.06.06 Agenda/Minutes

---

Time 1600 (GMT) - See the time in your timezone

• Co-Chair - Henry Richards (WattTime)
• Co-Chair - Naveen Balani - (Accenture)
• Co-Chair – Abhishek Gupta (BCG)
• Convener – Sean Mcilroy (Linux Foundation)

Antitrust Policy

Joint Development Foundation meetings may involve participation by industry competitors, and the Joint Development Foundation intends to conduct all of its activities in accordance with applicable antitrust and competition laws. It is, therefore, extremely important that attendees adhere to meeting agendas and be aware of and not participate in any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws.

If you have questions about these matters, please contact your company counsel or counsel to the Joint Development Foundation, DLA Piper.

Recordings

WG agreed to record all Meetings. This meeting recording will be available until the next scheduled meeting.

Roll Call

Please add 'Attended' to this issue during the meeting to denote attendance.

Any untracked attendees will be added by the GSF team below:

• Full Name, Affiliation, (optional) GitHub username

Agenda

• Approve agenda
• Approve previous Meeting Minutes

New Member Introduction

• Opportunity for new members to say hi.

Project Deep Dive review

• Software Carbon Efficiency Rating Chris Xie (Futurewei) - Chris Xie (Futurewei)
  • Opportunity for members to offer feedback and raise concerns

Techstrong TV Sustainability Interview with Bonnie Schneider - Sean

• Techstrong Interview with SWG member(s) to discuss the SCI
• Update - The following names have been submitted
  • Chris Xie (Future Wei)
  • Navveen Balani (Accenture)
  • Greg Rivera (CAST)
  • Tammy McClellan (Microsoft)

GreenAI - Discussion Continued - Henry / Thomas

• Green AI Committee update/rollout plan
  • Green AI Project Proposal Early Brief.pdf

Project Review updates

• Real-Time Cloud - Adrian
  • Defining the GSF Real-Time Cloud Renewable Energy Percentage spreadsheet.
  • collaboration documentt to create the initial header explanations.
• Transforming Organisational Software Sustainability
• sci-guide - Navveen

Articles

• Nothing to review

For Review

• Lifecycle Assessment (LCA) for Software Applications using SCI and Impact Framework - Srini

Note:
WG use case template submission - After submitting this issue, your use case will be submitted to the WG Agenda for discussion.
Article submission—Once you submit this issue, it will be assigned to the GSF Editor for review.

Future meeting Agenda submissions

• If you have any Agenda submissions, please let Sean know via email at [email protected] or open an Issue

Next Meeting

• 20th Jun

Adjourn

• Motion to adjourn

---

Standing Agenda / Future Agenda submissions

• Standing Agenda Item: The First meeting of each month is a member Introduction / Buddy-buddy meeting to help new members understand the work in the SWG.
• Standing Agenda Item - First meeting of each month - 5 - 10 min round up of what is happening across the other WG

[tholewis]

Attended! 🌳

[GadhuNTTDATA]

Attended

[chrisxie-fw]

attended

[navveenb]

Attended

[adrianco]

Attended

[seanmcilroy29]

Attended

[seanmcilroy29]

MoM
Sean opens the meeting at 1600 (BST)

• Chris emphasized the significance of carbon efficiency in large language models. Asim recommended establishing processes for consensus-building in larger organizations. Asim also proposed a path to ISO adoption from a regulatory perspective as Northstar's objective and provided evidence of consensus through feedback.

• Chris discussed open-source initiatives for industry transformation, the SCER specification for efficient routing in the industry, and a 4-step process for software cost categorization and benchmarking. Additionally, Gadhu discussed changes in categorizing language models based on size and application type.

• Asim suggests categorization and benchmarking for large Lego models, with Chris providing examples.
  Chris outlines a 4-step process for standardizing national models, including measurement methods and workload (uses current kilowatt hours). Chris suggests aligning token disclosure with SCI to facilitate adoption and streamline work (10 years' worth of work).

• Chris discussed challenges in comparing LLMs' performance scores, Hugging Face's role in hosting and benchmarking language models, and challenges in categorizing software due to its diverse range of functions.

• Asim and Navveen discussed the challenges of categorizing and comparing AI models. Navveen proposed extending SCI specifications to accommodate LLMs and scenario ratings. They also talked about potential extensions to the SCI standard for AI and cloud computing. Thomas questions the spec's implementation and the providers' responsibility to provide information. Chris discussed collaboration with Hogging Face to improve LLM testing reproducibility.

• Asim stresses the importance of managing intellectual property (IP) and royalties properly in collaborations. Asim believes that providing evidence is crucial for proving Social and Environmental Impact (SCI) scores. He suggests that linking manifest files to scores can create strong support among different measurement tools. Asim thinks it is important to have a common evidence file format for the impact framework, and believes that the focus should be on developing tools for the impact framework.

• Members discuss developing a global label for software projects to provide transparency on carbon footprint.
  Asim suggests open-source LLM models for labelling and verifying emissions reductions. The group discussed updates to the SCI methodology and potential regulatory issues.

Action Items

• Schedule a follow-up meeting in two weeks to provide updates on the SCER specification.
• Revisit the SCER specification based on feedback from the discussion.
• Consider opportunities to extend the SCI standard to specifically cover AI/language models.