Skip to content

SEPIA-Home v2.6.0 with redesigned audio interface, new STT server, more powerful widgets and many more improvements
Compare
Choose a tag to compare
@fquirin fquirin released this 14 Oct 21:47
· 160 commits to master since this release
v2.6.0
16b6cb0
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

v2.6.0 - 2021.10.14

After almost one year in the making SEPIA-Home v2.6.0 has finally been released 🌠 and it is packed with amazing new features that will greatly enhance the overall voice-UI experience and pave the way for many new possibilities to customize and extend your own open-source assistant ✨ 😌 .

Heart of this update is the newly developed, modular SEPIA Web-Audio library that replaces the old audio interface and comes with state-of-the-art tools for audio recording and processing 🗣️ 🎶 🧑‍🔬 . Among other things the new library includes modules for wake-word recognition (via Porcupine v1.9), voice-activity-detection (VAD), audio resampling and the brand new version of the SEPIA Speech-To-Text (STT) server 🔥 . The new SEPIA STT-Server has been redesigned from scratch to support multiple, different STT engines (like Vosk), post processing of results (e.g. via text2num) and dynamic loading of ASR models while running on all major platforms, even Raspberry Pi 4! This elevates open-source speech recognition inside the SEPIA client to a whole new level 😎 🚀 .

Another important feature is the improved support for custom voice-widgets 👨‍🎨 📱 and the introduction of new media-player widgets 🧑‍🏭 📻 which will enable users to build own interfaces, dashboards, micro-apps (see clock demo) or music players just by creating a simple HTML file with a few lines of Javascript code 👩‍💻 and placing it inside the widgets folder. The SEPIA-Extensions repository has been updated to show some examples and collect future work (contributions are welcome ^^).

This release has a lot more to discover, so check-out the extended release notes or the "shorter" version below! Hope you enjoy the update ✌️ 😃.

Download SEPIA-Home - Download Android APK - See Twitter news feed

Release notes (short) - Extended version: here

Updated client to v0.24.0:

  • Complete rework of audio system and switch to new SEPIA Web-Audio library:
    • Handle audio processing in 'AudioWorklets' and 'Worker' threads
    • Support for new SEPIA STT Server v2 with many new features (Docker container for all platforms available)
    • New WebRTC VAD (voice-activity-detection) module and experimental custom VAD module
    • Support for many new Porcupine wake-words like Computer, Jarvis, Alexa, Hey Siri, Hey Edison and many more
    • Support for external TTS server (Mary-TTS compatible API)
    • Added support for media-device selection (mic and speaker) and microphone test-page
    • New audio-effects library (e.g. for TTS filter effects etc.)
    • Support for MediaSession API
  • Greatly improved features and support for custom voice-widgets (aka custom views/frames) including handling of speech events, input and animations (build your own voice interfaces)
  • Completely new embedded media-player with custom widget support and powerful interface (build your own audio players)
  • Improved Teach-UI commands overview + search field + support for improved 'music' service that works with new media-player widgets
  • Implemented remote action 'notify' and updated 'broadcast' interface and button (broadcast TTS messages to clients with same account)
  • New cards for audio, graphs (µPlot lazy lib.) and embedded content like YouTube + detection of YouTube URLs in chat
  • Improved cards context-menus, e.g. to start media-player remotely on other connected clients
  • Improved speech recognition support for Microsoft Edge and Apple's Safari browser (via Web-Speech API)
  • Landscape mode for mobile screens (including orientation API support) + improved 'big-screen' mode
  • New skins (+ improved older ones) 🎨 : 'Alabaster' (3 variants), 'Essential' (green + orange), 'Orange Style 2.0' (OS2)
  • New avatars 👀 : 'The Dots', 'Classy', ILA O-Five (3 variants), 'S-Tech'
  • Added ability to reload/refresh basic lists via context menu button
  • Many style and UI improvements + updated icon-set
  • Improved main menu (settings view) + updated tutorial
  • Added button to export (show) client settings as JSON (handy for headless client setup)
  • Made experimental languages accessible via language selector
  • Improved service-worker handling + offline page and disabled service-worker by default (use new URL param. 'pwa' to enable)
  • ...

Updated Control-HUB (admin-tools) to v1.4.1:

  • Added 'get mediadevices' command to CLEXI help
  • Updated icon set + improved service-worker and offline.html
  • Replaced legacy STT page with new info page

Updated Assist-server to v2.5.2:

  • Created new 'WebContent/widgets' folder and added default media-player (YouTube etc.) files
  • Added new 'clock' demo view to 'WebContent/views' folder and updated old demo view
  • Updated 'MusicSearch' service to support new media-player widgets and 'data' parameter
  • Added new YouTubeAPI class and updated config and property files to support API key
  • Tweaked YouTube web-search results
  • Updated radio stations
  • Updated news outlets
  • Prepared open-liga worker and parameters for new season (Bundesliga)
  • Added Porcupine wake-word files for HTML client to 'WebContent/files' folder
  • Added support for optional 'delayUntilIdle' parameter of client_control_fun ACTION
  • Updated 'ActionBuilder' class with more convenience methods
  • Improved handling of list data and updates (this includes timers and alarms)
  • ...

Updated WebSocket Chat-Server to v1.3.2:

  • Added 'notify' as 'RemoteActionType'

Updated Teach-Server to v2.2.2:

  • Added support for sorting commands by date
  • Added Teach-UI service 'music' (music search)
  • Allow custom (success) answers for music stream commands

Updated Core-tools to v2.2.9:

  • Added fields to UserDataList 'checkable' item: 'itemId', 'priority' and 'dateAdded'
  • Added optional 'delayUntilIdle' to client_control_fun ACTION
  • Removed dependency 'google.guava' (use 'Apache Utils' and Java 8 classes instead)

Make sure you don't miss this:

Assets 4
Loading