Deepnote docs
Deepnote.com
Join the team
Changelog
Search…
Deepnote documentation
📹
Getting Started
Getting started with Deepnote
💡
features
Command palette
Real-time collaboration
Comments
Integrations
SQL blocks
Chart blocks
Variable explorer
Terminal
Versioning
Scheduling
Code intelligence
Dark mode
Keyboard shortcuts
Input blocks
🤝
Collaboration
Teams and Workspaces
Workspace permissions
Sharing a project
Publishing a project
Launch repositories in Deepnote
⚙️ Environment
Selecting hardware
Custom initialization
Custom environments and install new packages
Long-running jobs
Environment variables
Incoming connections
Pre-installed packages
Python requirements
🔧
Integrations
GitHub
Docker Hub
Google Container Registry
Amazon ECR
Amazon S3
Google Cloud Storage
PostgreSQL
ClickHouse
Athena
Redshift
MongoDB
MariaDB
MySQL
MindsDB
Google BigQuery
Snowflake
Large files
Google Drive
Dropbox
Spark
Supabase
Authorize connections from Deepnote IP addresses
SSH Key
Great Expectations
Telegram
Slack
Notion
GitLab
Tracking experiments
📥
Import & export
Importing data to Deepnote
Sharing and embedding blocks
Export a notebook
Export a project
Export to PDF
🏷️ resources
Support
Product portal
Referral program
Intellectual property
Pricing
Changelog
Deepnote Community
Okta SSO
Terms & Conditions
Security
Powered By
GitBook
Spark
Pyspark
To use
pyspark
in Deepnote, you need to install a JDK first.
1
! sudo apt-get update
2
! sudo mkdir -p /usr/share/man/man1
3
! sudo apt-get install -y openjdk-11-jdk
4
! pip install pyspark
Copied!
Now you can test it in a notebook cell with:
1
from pyspark import SparkContext
2
sc = SparkContext("local", "First App")
Copied!
or in a terminal by opening an interactive shell:
1
pyspark
Copied!
Integrations - Previous
Dropbox
Next - Integrations
Supabase
Last modified
5mo ago
Copy link