Rename jar package name-Collection of common programming errors
jarjar might be able to do this.
It’s designed to build a single big jar containing an application and its supporting libraries. It supports moving the libraries into different packages to avoid naming conflicts (for example you could use two different versions of the same library with different package name prefixes).
It can probably be configured to do what you want.