一、安装教程1. 官方下载https://www.jetbrains.com/idea/2. 社区版一般就够用了, 可直接下载免安装版的;二、导出java -jar可运行jar1. Idea自带打包方法参考链接_01参考链接021. 导出jar前的配置2. 打包jar3. 删除jar中的校验信息2. 用Maven插件maven-shade-plugin打包参考链接02?xml version1.0 encodingUTF-8? project xmlnshttp://maven.apache.org/POM/4.0.0 xmlns:xsihttp://www.w3.org/2001/XMLSchema-instance xsi:schemaLocationhttp://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd modelVersion4.0.0/modelVersion groupIdcom.transsion/groupId artifactIdserverless_info/artifactId version1.0-SNAPSHOT/version properties project.build.sourceEncodingUTF-8/project.build.sourceEncoding jar_nameserverless_info_20250626/jar_name main_classTest/main_class /properties dependencies dependency groupIdcom.aliyun/groupId artifactIdalibabacloud-emr_serverless_spark20230808/artifactId version1.0.20/version /dependency dependency groupIdcom.aliyun/groupId artifactIdemr_serverless_spark20230808/artifactId version2.2.3/version /dependency /dependencies build finalName${jar_name}/finalName sourceDirectorysrc/main/java/sourceDirectory resources resource directorysrc/main/resource/directory includes !--包含文件夹以及子文件夹下所有资源-- include**/*.*/include /includes /resource /resources plugins plugin groupIdorg.apache.maven.plugins/groupId artifactIdmaven-shade-plugin/artifactId version1.4/version configuration createDependencyReducedPomtrue/createDependencyReducedPom !-- 禁止生产签名文件-- filters filter artifact*:*/artifact excludes excludeMETA-INF/*.DSA/exclude excludeMETA-INF/*.SF/exclude excludeMETA-INF/*.RSA/exclude /excludes /filter /filters /configuration executions execution phasepackage/phase goals goalshade/goal /goals configuration transformers transformer implementationorg.apache.maven.plugins.shade.resource.ManifestResourceTransformer mainClass${main_class}/mainClass /transformer /transformers /configuration /execution /executions /plugin plugin groupIdorg.apache.maven.plugins/groupId artifactIdmaven-compiler-plugin/artifactId configuration source8/source target8/target /configuration /plugin /plugins /build !-- 必须配置阿里云的阿里云仓库否则无法下载依赖-- repositories repository idrelease/id urlhttps://s01.oss.sonatype.org/content/repositories/public/url snapshots enabledtrue/enabled updatePolicyalways/updatePolicy checksumPolicywarn/checksumPolicy /snapshots /repository repository idsnapshots/id urlhttps://s01.oss.sonatype.org/content/repositories/snapshots/url snapshots enabledtrue/enabled updatePolicyalways/updatePolicy checksumPolicywarn/checksumPolicy /snapshots /repository /repositories /project三、 Java代码自动转Scala代码IDEA Java代码自动转Scala代码四、大数据环境配置1) hadoop的windows本地安装包idea 提示ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path java.io.IOException解决方法idea 提示ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path java.io.IO2) 不能初始化SparkContextERROR SparkContext: Error initializing SparkContext.本地Spark会话中的Spark URL无效添加:SparkSession.config(spark.driver.host, localhost)val spark: SparkSession SparkSession .builder() .appName(test) .config(spark.default.parallelism, 2) .config(spark.sql.debug.maxToStringFields, 100000) .config(spark.debug.maxToStringFields, 100000) .config(spark.driver.host, localhost) .master(local[2]) .getOrCreate()4. 安装scala插件IntelliJ IDEA安装scala插件并配置scala环境变量的详细教程注意:插件的下载速度和使用的网络类型有关, 网络好直接在线安装就行, 网络宽带下载速度慢可以手机开热点下载;九九、问题汇总1. 找不到或无法加载主类1) 执行的类所在的目录, 是非source目录;2 更改pom文件后, 要手动更新3 idea用maven打包时, 报包不存在但实际上包存在的问题1) 删除target文件时, 有别的程序正在占用这个目录(xftp)a. Idea---file---Invalidate Cachesb. 重启电脑2) 在Build菜单栏中重新构建项目4 idea经常崩溃1) 报错代码A fatal error has been detected by the Java Runtime Environment2) 错误原因a. 打开的项目中有大量数据文件, 打开时导致内存溢出5 不能引入maven依赖最好关闭自动导包手动引入6 更改spark版本后不能运行1报错如下Exception in thread main java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps2解决办法a. maven中的scala版本与idea自带的不一致参考01参考02b. Rebuild Projectc. 确认是否用了最新的jar包是传的最新的jar 上传命令是否有问题下载的jar是否最新的可以起一个独特的名字上传避免混了7. tokens1) 错误提示scalac: Token not found: C:\Users\xxx\AppData\Local\JetBrains\IdeaIC2021.3\compile-server\tokens\32002解决方式