Clojure Q&A - Recent questions tagged uberjar

create-basis uses the wrong local maven repository

Sat, 24 Sep 2022 08:29:08 +0000

I am attempting to build a Clojure project with numerous dependencies and contain everything into a single folder. The reason for doing this is because I will eventually build this software in an environment where I am not permitted to modify the home folder.

The following command is being used
GITLIBS=/var/build/software/.gitlibs clojure -Srepro -Sdeps '{:mvn/local-repo "/var/build/software/.m2/repository"}' -T:build uber-aot

tools.deps is able to download all dependencies into the specified local repository. Once it's time for tools.build to run, I seem to get an error in the middle of a call to b/create-basis. Here is what the error looks like.

Execution error (FileNotFoundException) at java.io.RandomAccessFile/open0 (RandomAccessFile.java:-2). /home/user/.m2/repository/org/clojure/clojure/1.11.1/clojure-1.11.1.pom.part.lock (No such file or directory)

Is there any way to pass in the local Maven repository to tools.build? Preferably in the command line.

Ability to customise java-cmd in tools.build

Sat, 27 Aug 2022 20:54:32 +0000

Moving the original question from Clojurians Slack:

When moving one of my projects to JDK 19 I was pointing clojure to the jdk using the JAVA_CMD env var. Everything was fine til I hit the uber jar step in the CI, where it simply refused to recognise the jdk 19 functions.

Took me a while and including reading the tools.build source to realise why it wasn't propagating the JAVA_CMD var and turns out I had to read env and send the :java_cmd in the b/compile-clj call.

I can see why the behaviour is like this, but would :java_cmd defaulting to the value of JAVA_CMD something that could be considered? Feels a bit more intuitive for me, as mostly the invocations of tools.build fns would be from the shell.

Files in deps :local/root :git/url will directly copy into uberjar without go through conflict-handlers

Fri, 22 Apr 2022 10:58:50 +0000

https://github.com/clojure/tools.build/blob/1309f935b098123eb807c972a053eeab77f6f4cd/src/main/clojure/clojure/tools/build/tasks/uber.clj#L172

The handling between jar and lib folders like git deps or local root are completely different. In my case, I have some config files in edn format (duct's duct_hierarchy.edn) exists in both jar deps and git deps. My additional conflict handler is never receiving the edn file that exists in git deps.

Is it the expected behaviour? I can imagine that even LICENSE or data_readers.clj would suffer the same issue. e.g. being overrided by files in git deps.

Is it possible to build an uberwar using deps.edn using tools.build or other tool?

Thu, 02 Dec 2021 13:22:01 +0000

We have a small Clojure & ClojureScript web app running in Tomcat. The project managed to end up with a deps.edn for use with Shadow-cljs & lein for the backend to essentially build an uberwar. Is there a way to build an uberwar with tools-build or in some other way using deps.edn?

Thanks for any pointers

Cheers
Daniel Sunnerek

tools.build uber's default conflict handlers don't append to META-INF/services properly

Fri, 26 Nov 2021 17:29:12 +0000

Our project has some dependencies that register parsers for various file formats via the java services framework.

We’re using b/uber and are finding some META-INF/services/ definitions are not correctly being appended.

I’ve chased this down to the regex in the default-handlers being ^META-INF/services/ instead of something more like ^META-INF/services/.*

The current regex would match under re-find, but not under re-matches which the implementation uses.

How to control the transient deps that get compiled/assembled into an uberjar?

Thu, 05 Aug 2021 16:36:31 +0000

I am having trouble understanding how to control the contents of an uberjar using tools.build. In this scenario, the runtime environment (a Spark cluster) provides some deps and thus those deps should not be in the uberjar. Let's say I have 2 classpaths (represented as aliases):

:compile The classpath with all deps/classes that are required for compilation.
:uber The classpath with only the deps/classes that should be in the final jar.

In theory, if you take the :compile classpath and subtract the :uber classpath, we should get the set of classes that are provided by the runtime environment.

Consider the following simplified dependency graph:

We only need the blue deps to be in the jar. The white "provided" deps need to be used during compilation but should not be in the final uberjar.

I looked into using the :filter-nses option of compile-clj but it creates problems with transient deps.

If we filter to only my.project we will lose the important deps of some.other/dep and some.transient/dep.
If we filter to exclude org.apache (not possible with :filter-nses, but in theory it could be done) we would still have org.scala-lang/scala-library hanging around.

I also experimented using different calls to create-basis during compile and jar building. I'm not sure if that makes any sense.

Is it possible to leverage the dependency graph to control either 1) what gets compiled or 2) which classes get put into an uberjar? Any advice would be much appreciated.

Using static files in project

Thu, 22 Apr 2021 18:13:10 +0000

Probably a very noob question, sorry about that. I have a monorepo structured like this:

api/ 
 |-deps.edn
 |-src/
   |-api/
     |-core.clj
     |-resource_1.csv
library/
 |-deps.edn
 |-src/
   |-library/
     |-core.clj
     |-resource_2.csv

deps.edn of the api uses library as local dependency. Both of them use static information from respective csv files.

My question is how do I correctly include the static files when compiling the api uberjar, and how do I correctly use the static files within the code?

The api does not have any endpoints where it's serving the static files. They're used inside the code for caclulations.

Fails to load gen-classed class with pf4j from uberjar

Tue, 26 Jan 2021 16:23:57 +0000

The problem here might be more related to the pf4j default classloader but still:

I have a clojure plugin generating a class

(gen-class
 :name myplugin.SomeExtension
 :implements [plugin.SomeExtensionPoint]
 :prefix "-"
 :impl-ns my-plugin.some-extension)

The plugin jar is loaded in my clojure application using pf4j. When it is compiled with lein jar the class loads (but then I naturally have to put any plugin dependencies in the apps project.clj). When compiled with lein uberjar it fails with:

 Execution error (IllegalStateException) at myplugin.SomeExtension/<clinit> (REPL:-1).
; Attempting to call unbound fn: #'clojure.core/refer

with top of call stack

jdk.internal.reflect.NativeConstructorAccessorImpl/newInstance0 (NativeConstructorAccessorImpl.java:-2)
jdk.internal.reflect.NativeConstructorAccessorImpl/newInstance (NativeConstructorAccessorImpl.java:62)
jdk.internal.reflect.DelegatingConstructorAccessorImpl/newInstance (DelegatingConstructorAccessorImpl.java:45)
java.lang.reflect.Constructor/newInstance (Constructor.java:490)
java.lang.Class/newInstance (Class.java:584)
org.pf4j.DefaultExtensionFactory/create (DefaultExtensionFactory.java:38)
org.pf4j.ExtensionWrapper/getExtension (ExtensionWrapper.java:37)
org.pf4j.AbstractPluginManager/getExtensions (AbstractPluginManager.java:971)

I've struggled a bit but I am unsure about exactly what happens here and how to solve it?
Any ideas are most welcome!

(and the uberjar profile uses {:aot :all :omit-source true})