Published by Theofilos Kakantousis on

Hopsworks 0.4.0 brings the latest features, improvements and bug fixes. Check the release notes below for both Hops and Hopsworks.

Release notes – Hopsworks – Version 0.4.0

Bug

  • [HOPSWORKS-420] – Transient directory of CertificateMaterializer should not be readable by user code
  • [HOPSWORKS-440] – Random number of executors displayed in the job metrics panel
  • [HOPSWORKS-444] – Fix spark local dir attribute in Spark-chef
  • [HOPSWORKS-446] – The hard drive full alert is spammy
  • [HOPSWORKS-447] – Grafana not working in yarn and hdfs admin pages
  • [HOPSWORKS-449] – User activation fails with ejb transaction error

New Feature

  • [HOPSWORKS-412] – Support for pip in Anaconda
  • [HOPSWORKS-434] – [ndb-chef] Bash script to periodically perform NDB backups
  • [HOPSWORKS-445] – Downloader for pre-downloading binaries for installation

Improvement

  • [HOPSWORKS-415] – Make HopsUtil work with http and improvements for https in HopsWorks, add HopsUtil support in Zeppelin and Jupyter
  • [HOPSWORKS-438] – Refactor CertificateMaterializer service

Release notes – hops – Version 2.8.2.3

Bug

  • [HOPS-109] – Quota management of Small Files
  • [HOPS-136] – Container logging does handle lost containers
  • [HOPS-137] – Quota is not recorded appropriately for small files which result in negative quota when deleting files/directories
  • [HOPS-140] – garbage container logs and checkpoint remaining int the database
  • [HOPS-143] – Quota multiplicator fixed period does not behave according to specification
  • [HOPS-150] – Test code was commited by accident and block from having more than one gpu
  • [HOPS-152] – app get stuck in NEW_SAVING when user name too long
  • [HOPS-155] – Store small files on the datanodes if the database disk tables are full.
  • [HOPS-157] – Nullpointer and Index out of bound since HOPS-152
  • [HOPS-170] – Slow deletionof very large directories

New Feature

  • [HOPS-141] – Monitor and control CertificateLocalizationService via JMX
  • [HOPS-147] – Reloadable key store manager

Improvement

  • [HOPS-131] – Base price should be different for GPU resource and for General resources
  • [HOPS-133] – Remove deploy-server.sh from hops-metadata-dal-impl-ndb and hops-gpu-management-impl-nvidia
  • [HOPS-138] – Increase detail of log output for processed block report
  • [HOPS-139] – Add another method for ContentSummary to return the results directly from inodes_attributes in quote enabled directories
  • [HOPS-144] – Disabled uber pricing
  • [HOPS-149] – Add app IDs in project daily cost
  • [HOPS-151] – App’s GPU usage in Yarn UI
  • [HOPS-153] – [hops-hadoop-chef] Secure webhdfs REST API
  • [HOPS-158] – Refactor HopsSSLSocketFactory and add check for Environment Variable set with crypto material
  • [HOPS-164] – fix hops schema updates for Flyway
  • [HOPS-166] – change flyway storage engine from innodb to ndb
Categories: Release