List of data science software

From Wikipedia, the free encyclopedia

This is a list of data science software and platforms used in data science, which includes programming languages, programming environments, machine learning frameworks, data engineering tools, statistical software, data analysis, plotting, MLOps systems, and more.

These interactive notebooks, IDEs, and platforms provide specialised development environments.

• Apache Zeppelin^[6]
• Architect — Eclipse (software)
• CoCalc
• Dataiku Data Science Studio
• FreeMat
• GNU Octave
• Google Colab
• DataSpell
• Jupyter Notebook / JupyterLab
• Kaggle Notebooks
• MATLAB
• O-Matrix
• PyCharm
• RStudio
• SAS (software) and SAS Studio^[7]
• Spyder
• Visual Studio Code ^[8]

The Machine learning / deep learning tools support development in those fields.

Examples of Data engineering tools.

• Apache Airflow
• Apache Flink
• Apache Hadoop
• Apache Kafka
• Apache NiFi
• Apache Spark
• Dask
• Data build tool (dbt)

Examples of Data mining tools.

Data warehouse environments include:

• Amazon Redshift
• Snowflake
• Google BigQuery
• Microsoft Azure Synapse
• Teradata
• Vertica ^[11]

Data lake environments include:

• Apache Hadoop
• Cloudera
• Databricks
• Delta Lake
• Amazon S3
• Google Cloud Storage
• Azure Data Lake ^[12]

• Apriori algorithm – frequent itemset mining and association rule learning in market basket analysis
• Backpropagation – algorithm for training artificial neural networks using gradient descent
• Decision Trees – tree-based algorithm for classification and regression
• Expectation–maximization algorithm – iterative procedure for maximum likelihood estimation with latent variables
• Gradient descent – iterative optimization algorithm for minimizing a loss function
• ID3 algorithm – used to generate a decision tree from a dataset
• K-Means – clustering algorithm based on minimizing within-cluster distances
• K-Nearest Neighbors (KNN) – instance-based learning and classification method
• Linear regression – estimation method for predicting a dependent variable based on independent variables
• Logistic regression – classification algorithm for predicting a binary outcome
• Naive Bayes – probabilistic classifier based on Bayes' theorem
• Ordinary least squares – estimation method for parameters in linear regression
• PageRank – graph-based algorithm for link analysis and search ranking
• Principal component analysis – technique to reduce high-dimensional data while preserving variance
• Q-learning – reinforcement learning algorithm for learning optimal actions
• Random forest – ensemble of decision trees for improved classification or regression
• Sequential minimal optimization – solver for training support vector machines
• Stochastic gradient descent – randomized variant of gradient descent for large-scale machine learning
• Support Vector Machines (SVM) – algorithm for finding a hyperplane to separate classes^{[13] [14]}

• CSPro
• Dataplot
• Epi Map
• X-13ARIMA-SEATS

• BV4.1
• MINUIT
• WinBUGS
• Winpepi

Tools for Data processing and analysis:

Software for Data visualization:

Software for plotting data to support processing and visualise resuls.

• ArcGIS
• Carto
• Epi Map
• GeoDA
• Google Earth Engine
• Leaflet
• Mapbox
• MountainsMap
• QGIS

MLOps and model deployment:

• BentoML^[16]
• Data Version Control (DVC)
• Kubeflow
• MLflow^{[17] [18]}
• Seldon Core^[19]
• Streamlit^{[20] [21]}
• TensorFlow Serving^{[22] [23]}
• Weights & Biases^[24]

• Kaggle – platform for data science competitions, datasets,^[25] and notebooks.
• Zenodo – open-access repository supported by CERN and the EU.
• University of California, Irvine Machine Learning Repository^[26]
• OpenML – collaborative platform for sharing datasets, algorithms, and experiments.^[27]

• Business intelligence software
• List of data science journals
• List of R software and tools
• Lists of mathematical software and List of open-source software for mathematics
• List of numerical-analysis software and List of numerical analysis topics
• List of open-source data science software
• Common Crawl – nonprofit that crawls the web and freely provides its archives and datasets to the public under an MIT License

• 20 Tools for Data Scientists | Pragmatic Institute
• igorbarinov/awesome-data-engineering

Retrieved from "https://en.wikipedia.org/w/index.php?title=List_of_data_science_software&oldid=1315481275"

Categories:

• Data science
• Science software
• Statistical software
• Machine learning
• Visualization software
• Data analysis software
• Data mining and machine learning software
• Data mining
• Big data
• Database management systems
• Data engineering
• Lists of software
• Software
• Programming tools
• Free and open-source software

Hidden categories:

• Articles with short description
• Short description is different from Wikidata