Another EAP 11 update has just been released for a plugin called Big Data Tools available for installation in IntelliJ IDEA Ultimate, PyCharm, and DataGrip. You can install it through the plugin page on the site or inside the IDE.
Big Data Tools is a plugin that allows you to connect to Hadoop and Spark clusters. It provides monitoring of nodes, applications and individual tasks. In addition, in IDEA and DataGrip you can create, run and edit Zeppelin notebooks. You don't have to switch to the Zeppelin web interface and work peacefully without leaving your favorite IDE. The plugin allows you to conveniently navigate through the code, do smart completion, refactorings and quick fixes right inside the laptop.
New type of launch config for spark-submit
— Spark- IDE, . IDE, PyCharm. , spark-submit bin Spark . : - . .
spark-submit , . , SSH, spark-submit . bash- , . , , - .
Big Data Tools , . run configuration, spark-submit, SSH, - . .
Apache Zeppelin DataGrip
Zeppelin DataGrip. DataGrip , - . , SQL .
, SQL. , Matplotlib Scala DataGrip .
- Spark-submit IntelliJ IDEA, DataGrip PyCharm (BDIDE-843).
- Apache Zeppelin DataGrip (BDIDE-1045).
- Zeppelin (BDIDE-906).
- Spark Monitoring (BDIDE-1159).
- Zeppelin (BDIDE-1172).
- Zeppelin: , (, HTML Zeppelin) (BDIDE-1132).
- Zeppelin: – IntelliJ IDEA 2020.1 Zeppelin, (BDIDE-1184).
- Zeppelin: – , /api/version (BRIDE-1199).
- Zeppelin: – (BDIDE-1171).
- Zeppelin: – Structure Zeppelin (BDIDE-1135).
- Zeppelin: Fixed – IDEA , (BDIDE-1208).
- Zeppelin: – "Open in browser" (BDIDE-1142).
- Zeppelin: – (BDIDE-1129).
- Spark Monitoring: – JSON, Storages, (BDIDE-1162).
- Remote FS: – Azure (BDIDE-1141).
- Remote FS: – (BDIDE-1192).
- Remote FS: – (BDIDE-1202).
- General: – (BDIDE-1195).
- HTTP Proxy: – Spark Hadoop SOCKS proxy (BDIDE-1209).
- HTTP Proxy: – SCOKS proxy (BDIDE-1215).
- HTTP Proxy: – (BDIDE-1216).
, Big Data Tools, . , Twitter.
, , , .
Big Data Tools