Skip to content

ITISFoundation/oSPARC-Hub

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

40 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

oSPARC Hub : An Extensible ETL Framework for Streamlining the SPARC Ecosystem

License Badge Build Status Version




Video Overview

webinar_preview

Table of Contents

Introduction

The SPARC Database offers a variety of datasets, including anatomical models, neural connectivity data available on the SCKAN database, physiological and electrophysiological data, genomics data, and more. These datasets are spread across different websites and typically require preprocessing before they can be visualized. Additionally, many models are not immediately usable and require significant preliminary work by the end-user to extract meaningful insights.

oSPARC is a platform provided by SPARC that offers services, code templates, and modules for managing various SPARC data types. However, not all datasets have dedicated visualization tools available on the oSPARC platform.

Data Type on SPARC Dataset Count Associated oSPARC Module/Service Action Required
SCKAN Database Various X Created one
Anatomical Models 40 + - Created one
Navigate SPARC Portal Datasets X Created one
Datasets
- Microscopy 100 V Tutorial
- Anatomy 96 V Tutorial
- Physiology 96 Tutorial
- Electrophysiology 62 V Tutorial
- Connectivity 52 V Tutorial
- Histology 35 - -
- Spatial Transcriptomics 22 - -
- Expression; Expression Characterization; Transcriptomics 22 + - Update + Add a UI
- Other <20 each - -

Presenting oSPARC Hub

The oSPARC Hub framework is a comprehensive suite of SPARC pipelines, modules, and applications designed to enhance the capabilities of the oSPARC platform. It introduces an integrated pipeline that allows users to navigate datasets directly from the SPARC portal within the platform.

Depending on the data type, there are three specialized applications available: one for accessing and utilizing data on the SCKAN database, another for exploring anatomical models on the SPARC Portal, and a third for working with genomics datasets. In addition, several modules have been developed to efficiently process various data types, ensuring seamless integration and usability.

image

In total, we have developed:

  • 3 oSPARC Application, and
  • 6 oSPARC Services

that are accessible via the oSPARC platform.

image

image

oSPARC Applications

App 1: Visualize Anatomical Modules Demonstration

Tutorial: https://github.com/SPARC-FAIR-Codeathon/oSPARC-Hub/blob/main/Apps/Tutorial%20for%20%3AVisualize%20Anatomical%20Modules.md

Source Code: https://github.com/SPARC-FAIR-Codeathon/oSPARC-Hub/tree/main/Apps/Visualize%20Anatomical%20Modules

App 2: Transcriptomics data visualization

This is an App for transcriptomics data analysis and visualization.

Tutorial: https://github.com/SPARC-FAIR-Codeathon/2024-team-5/blob/main/Apps/Tutorial%20for%20:Transcriptomics%20data%20visualization.md

Source Code: https://github.com/SPARC-FAIR-Codeathon/2024-team-5/tree/main/Apps/Transcriptomics%20data%20visualization

App 3: Visualize SCKAN datadase data

This app allows you to access data fromm the SCKAN database.

Tutorial: https://github.com/SPARC-FAIR-Codeathon/2024-team-5/blob/main/Apps/Tutorial%20for%20%3A%20Visualize%20SCKAN%20datadase%20data.md

Source Code: https://github.com/SPARC-FAIR-Codeathon/2024-team-5/tree/main/Apps/Visualize%20SCKAN%20datadase%20data

oSPARC Services

Service 1: File Format Converter

This module allows conversion of files between various formats such as CSV, JSON, YAML, XLS, XLSX, NWB (Neurodata Without Borders) and many others.

Dedicated GitHub Repo: https://github.com/SPARC-FAIR-Codeathon/2024-team-5-service-1 DOI

Citation: Appukuttan, S., Benaribi, H., & Rievers, F. (2024). oSPARC Service #1: File Format Converter. Zenodo. https://doi.org/10.5281/zenodo.13308896

Service 2: VTK Converter

This module converts .vtk files to their .stl and .obj equivalents, which have wider support with visualization libraries.

Dedicated GitHub Repo: https://github.com/SPARC-FAIR-Codeathon/2024-team-5-service-2 DOI

Citation: Appukuttan, S., Benaribi, H., & Rievers, F. (2024). oSPARC Service #2: VTK Converter. Zenodo. https://doi.org/10.5281/zenodo.13308927

Service 3: Visualize 3D Model

This module offers a quick and simple visualization of 3D scaffold models.

Dedicated GitHub Repo: https://github.com/SPARC-FAIR-Codeathon/2024-team-5-service-3 DOI

Citation: Appukuttan, S., Benaribi, H., & Rievers, F. (2024). oSPARC Service #3: Visualize 3D Model. Zenodo. https://doi.org/10.5281/zenodo.13308931

Service 4: Fetch Scaffold From SPARC Portal

This module can fetch scaffold .vtk file from SPARC Portal for specified datasets.

Dedicated GitHub Repo: https://github.com/SPARC-FAIR-Codeathon/2024-team-5-service-4 DOI

Citation: Appukuttan, S., Benaribi, H., & Rievers, F. (2024). oSPARC Service #4: Fetch Scaffold From SPARC Portal. Zenodo. https://doi.org/10.5281/zenodo.13308937

Service 5: Tabular Data Viewer

This module enables users to view tabular data fromw within study.

Dedicated GitHub Repo: https://github.com/SPARC-FAIR-Codeathon/2024-team-5-service-5 DOI

Citation: Appukuttan, S., Benaribi, H., & Rievers, F. (2024). oSPARC Service #5: Tabular Data Viewer. Zenodo. https://doi.org/10.5281/zenodo.13308941

Service 6: Transcriptomics Data Explorer

This module allows users to explore and visualize transcriptomic data.

Dedicated GitHub Repo: https://github.com/SPARC-FAIR-Codeathon/2024-team-5-service-6 DOI

Citation: Appukuttan, S., Benaribi, H., & Rievers, F. (2024). oSPARC Service #6: Transcriptomics Data Explorer. Zenodo. https://doi.org/10.5281/zenodo.13308944

Deployment Status

The services are awaiting deployment to oSPARC production. The GitHub actions fail, as we do not have the required permissions for the build stage:

/home/scu/.venv/bin/python3: can't open file '/home/scu/.venv/bin/ooil': [Errno 13] Permission denied

Service has been deployed and tested locally via:

make publish-local

License

This project is licensed under the MIT License - see the LICENSE file for details.

Team Members

  • Shailesh Appukuttan - Aix-Marseille Université, CNRS, INT, Marseille, France - @appukuttan-shailesh
  • Hiba Ben Aribi - University of Tunis El Manar, Tunis, Tunisia
  • @HibaBenAribi
  • Fynn Rievers - Tilburg University, Tilburg, The Netherlands - @schrievicode

Have an issue or question?

Please open an issue here.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%