Published by Theofilos Kakantousis on

Hopsworks 0.5.0 brings the latest features, improvements and bug fixes. Highlights include:

  • TensorFlow 1.8
  • Spark 2.3.0
  • Kafka 1.1.0
  • Improved UI for managing Python libraries

Release notes – Hopsworks – Version 0.5.0

Bug

  • [HOPSWORKS-443] – Job service UI should hanldle error when creating jobs with same name
  • [HOPSWORKS-465] – Spark chef must check if glassfish cert exists
  • [HOPSWORKS-469] – CertificateMaterializer wipes out password in wrong order
  • [HOPSWORKS-470] – tensorflow-serving-api requires tensorflow and will uninstall tensorflow-gpu on python 2.7
  • [HOPSWORKS-471] – Fix for path bug introduced in 415, make email activation link disabled by default.
  • [HOPSWORKS-472] – 471 fix and other fixes
  • [HOPSWORKS-473] – bug – dela_client_type removed from variables
  • [HOPSWORKS-474] – Fix how Jobs service parses Spark properties
  • [HOPSWORKS-475] – kagent reports negative memory usage
  • [HOPSWORKS-479] – Kagent reporting if a host has GPUs not working
  • [HOPSWORKS-483] – NPE when creating a Spark job with no main class specified
  • [HOPSWORKS-485] – Fix bug with multiple kagent libOp commands
  • [HOPSWORKS-486] – Fix flyway sql for HOPSWORKS-443
  • [HOPSWORKS-494] – Approving User Accounts still broken
  • [HOPSWORKS-495] – Dela retry timeout at ~0ms
  • [HOPSWORKS-496] – Configuration option to disable services certificate rotation
  • [HOPSWORKS-497] – R should be installed in spark-chef, not zeppelin-chef
  • [HOPSWORKS-502] – Fix bug when revoking old Host certificate
  • [HOPSWORKS-503] – Remove unused js from admin
  • [HOPSWORKS-504] – Add hops::ndb as a dependency for hops:nn
  • [HOPSWORKS-506] – Pia saving bug
  • [HOPSWORKS-508] – Libraries installed by the Kagent anaconda_env.sh should say auto-yes
  • [HOPSWORKS-515] – Increase validity period for Host certificates if rotation is disabled
  • [HOPSWORKS-521] – [hopsworks-chef] Wrong ownership of CRL
  • [HOPSWORKS-522] – Kafka max projects is set to ’10’
  • [HOPSWORKS-528] – Pydoop with Python2 and Python3 support are now available in the same PyPi library
  • [HOPSWORKS-534] – Qr code recovery password check not working
  • [HOPSWORKS-535] – Allow the exclusion of machines from the conda environment creation
  • [HOPSWORKS-538] – Remove spark.metrics.conf from Jupyterc config file
  • [HOPSWORKS-539] – Job parameters not set correctly
  • [HOPSWORKS-544] – Kafka work with DNS hosts and other user names
  • [HOPSWORKS-545] – Force deleting of remote material should not try to acquire the lock
  • [HOPSWORKS-549] – Fixes for Horovod
  • [HOPSWORKS-557] – Remove typo and fix for /app
  • [HOPSWORKS-562] – HopsLog – log4j.properties copy into hops fails
  • [HOPSWORKS-572] – [chef] Fix random failure of spark::yarn on multi-node environments
  • [HOPSWORKS-573] – TensorFlow Serving API not installed correctly
  • [HOPSWORKS-576] – AppendConfigReplacementPolicy should not append whitespace for all spark properties
  • [HOPSWORKS-581] – Add missing HADOOP_HDFS_HOME variable in kernel.json for Jupyter
  • [HOPSWORKS-588] – Horovod UI bug in Jupyter configuration
  • [HOPSWORKS-589] – Hosts table in Admin UI should be scrollable
  • [HOPSWORKS-590] – DataScientist role must be added in GET PIA endpoint

Sub-task

New Feature

  • [HOPSWORKS-454] – Service key rotation
  • [HOPSWORKS-468] – Kagent restart button and upgrading hopsworks fixes
  • [HOPSWORKS-476] – Support for zipping directories inside project
  • [HOPSWORKS-477] – Allow custom mirror configuration in conda
  • [HOPSWORKS-489] – Revoke users/services certificates from Hopsworks
  • [HOPSWORKS-513] – TensorFlow Debugger support
  • [HOPSWORKS-536] – Speed up Conda Environment creation using ‘clone’
  • [HOPSWORKS-541] – Export and Create Anaconda environment using “conda env export” and “conda env create”
  • [HOPSWORKS-542] – REST endpoints for signing and revoking application certificates
  • [HOPSWORKS-551] – Conda UI for admins to see conda logs and retry failed operations
  • [HOPSWORKS-554] – Show versions of software used in Hopsworks

Improvement

Task

Categories: Release