Page 1 of 8

[myHD 0.6.1] RC3 version ... Ubuntu 1804 Bionic as default

Posted: Wed Aug 08, 2018 3:01 pm
by philippe
Hi,

FIRST
==== READ CAREFULLY the install procedure
TARGET : test the installation part ... and play with myHD internal QPKG proposed :
... kodi17.6 (possible to cp your actual .kodi), kodi18 Beta 5 or + (unstable build), plexmediaplayer 2.20.0 or +, Vlc 2.2.27, Chrome (last stable from Chrome PPA), Netflix (Chrome direct App. call, Test ... in fact a Xterm INSIDE myHD
===== PLEASE REFER TO SPECIFIC POST for each Applications ... WE PROPOSE MANUAL LAUNCH to understand problems (if needed)

COMMANDS TO KNOW :
myHD ... use for lot of usage including backup, update (apt-get update; apt-get dist-upgrade), set various options, move an existing Q.T.S user to myHD (clone UID/GID, set DISPLAY, set ssh keys for command without password from HD_Station or Q.T.S.)
myHD_root [command in quote] ... enter as root in myHD isolated environment or execute in myHD the command or script ...
myHD_user USER_NAME [command in quote] ... enter as user ... only user available after install is : qnap user / password qnapfr1 please change by security I don't use it)
myHD_qpkg ... manage myHD QPKG's (install, remove, create, etc.)

[Name]
myHD

[Version]
R.C. 3 : 0.6.1
... SOLVE BUGs in new I.R management
... ... Disable new I.R. return to original table definition (get at boot or at first run ... one time)
... ... update the install_package script
... ... rewrite Enable I.R management totally
==== ATTENTION this is beta and have limited keys supported for QNAP R.C. (seem it's better with MCE R.C.)
... other minor bug or erroneous text corrected
==== BEFORE UPDATE remember :
... ... Disable IR management if you have set it Enable (to don't reload QNAP table) ... even it can be do after
... ... Autorun is based on HD_Station but started by myHD ... so don't be afraid is Autorun (myHD QPKG) start after install ...

R.C. 3 : 0.6
... Ubuntu 18.04 is now the default for fresh install (switch Ubuntu version ... is always available)
... ADD beta version of NEW I.R. Management to works ever with HD_Station and / or myHD application
... ... it's a dynamic addons INSIDE HD_Station
... ... Applications receive keyboard event in place of LIRC (stopped ... so for debug search keyboard input)
... ... Beta because the mapping of R.C. keys to keyboard are MY choice BUT can be change (easily) for your own need
... ... support lot of remote control including some TV R.C. etc. protocol supported are RC-6 (default QNAP), NEC, RC-5, JVC, SONY, SANYO (ex. NEC is used by Samsung T.V. R.C.)
... ... lot of P.C. R.C. are already define
... ... specific documentation on How to do will be write, please wait, but web documentation can be used (base is to know keyboard use for the application)
... ... for special case you can use a key mapping table PER application
... ... Chrome Application mode can use it (Netflix, Primevideo, Youtube, etc.)
... ... KNOWS LIMITATIONS :
... ... ... some key (very few) can be intercepted by HD_Station / QTV ... no idea why and how
... ... ... for a short time I hope ... multitask mode is restricted with R.C. as QNAP ... but a solution is under test ...
... ADD support of autorun for myHD application
... ... use the HD_Station set autorun in settings
... ... ATTENTION application (ex. kodi18) start after myHD is started ... so you can have QTV (desktop) displayed for a few time before application is automatically launched
... wireguard VPN will be provide as a separate QPKG in few days (time to write a how-to) for x86_64 and armhf (kernel 4.2) ... not for arm64 (segfault without visible reason)
... clean shells and solve potential bugs

R.C. 2 : 0.5.1
... clean shells and solve potential bugs
... CHANGE installation shell to :
... ... solve a potential problem for system with high level CPU (race condition)
... ... ADD trace in manual installation mode (exec .qpkg in a console) on demand
... ... ... to get it just do : touch /share/Public/.myHD_trace_qinstall (this file will be deleted when you run the .qpkg file
... ... ADD trace in myHD command (use only in case of problem on a command)
... ... ... to get it just do : touch /share/Public/.myHD_trace_run (this is for one command ... file is deleted after the last myHD command ... )
... IN case of low internet connection use the pre-download shell to prepare installation and reduce install time : https://www.father-mande.ovh/phpBB3/vie ... 1564#p1761

Release Candidate 2 : 0.5
... solve various bugs
... clean some shell scripts with potential problem in some case
... ADD support for Ubuntu 18.04 Bionic environment ALPHA ALPHA ALPHA ALPHA
... ... this environment can be installed IN PARALLEL to the actual 16.04 (or alone for a fresh install)
... HOW load / install and switch to 18.04 (16.04 is keep ... so you can switch between the two ... )
... ... first backup your personal data in myHD (no need for shared resources)
... ... first install myHD 0.5 QPKG
... ... then use myHD switch_ubuntu_env 1804
... ... this stop myHD switch to 18.04 if 18.04 is not installed ... download files (so Internet is require) ... install environment SO BE PATIENT ... WITHOUT removing 16.04
... ... same HD_Station QPKG can be used for 16.04 or 18.04 ... so if you have already kodi18 available ... click on the icon and launch 18.04 version
... ... remember that home are in different folder so you can copy your settings from 16.04 to 18.04 (take care to owner of files)
... ... in 18.04 Kodi18 is Beta3 / plexMediaPlayer is 2.2.0 / mykodi17 ported is also available
... HOW do a fresh install directly (so not update) with 18.04 version (ALPHA) or an update with switching directly to 18.04 (NOT FULLY TESTED)
... ... just BEFORE INSTALLING myHD QPKG create a file : /share/Public/.install_myHD_1804
... ... this force to get 1804 and the file .install_myHD_1804 will be delete when installed

Release Candidate : 0.4.1
... solve severe Bug in myHD internal QPKG build script (sorry ... it's due to the renaming folder)

Release Candidate : 0.4
... ... ... ... ATTENTION in case of update ... the folder are rename (it's done by the QPKG install ... but ... )
... solve multiple small bugs
... ADD support for multiple Ubuntu version .... target Bionic 18.04 L.T.S. (few days) for the moment beside 16.04 but easy to get existing settings
... ... Alpha version works well ... but need some adaptation to be compliant with actual myHD (hope in days)
... ADD new task to get a better sound card visibility (direct access vs. pulse access) in Application (like Kodi18/17)
... Updated Ubuntu for fresh install (do by myHD apt_upgrade_package for installed users)
... ... include last Chrome (69.0.3497.100) and last Kodi18 Beta2
... introduce new concept (require a dynamic change in HD_Station) to support IR (remote control) including QNAP model IN HD_Station and IN Ubuntu myHD namespace (T.B.C. more test are require)
Documentation to integrate very simply your (any) application is in the process of writing ... so be patient ...
FORGOT : ... to add input group to users ... for IR-CEC support ... sorry I will do it in next R.C. please do it manually as explain in message on the subject in this sub-forum

Beta : 0.3.1
ATTENTION Ubuntu environment is moved (if you have use the change for avoid Qboost bug ... return to default folder position)
... ... ... ... https://www.father-mande.ovh/phpBB3/vie ... 1467#p1626

... Solve MAJOR BUG due to Qboost that suppress myHD data without informing users
... SO ... not all features schedule for 0.3 are inside (due to Qboost problem URGENT)
... Add squashfs support (kernel module for 4.2.8 tested on TS-x53 Pro and TVS-x73 models I own)
... ... squashfs is useful for extract or mount AppImage and require for snap(s)
... rewrite install package and create PACKAGE.myHD package specific for installing program (your) in myHD and generate QPKG for HD_Station
... solve minor bugs
... rename "clone user" in place of "move user" when you clone an existing user in myHD
REMEMBER NOT FOR UPDATE but IF YOU WANT to remove myHD prefer using internal uninstall : myHD uninstall_myHD

Beta : 0.2
... correct BUG target folder not created when include folder is sued (patch provide for 0.1
... correct BUG when a QPKG generation failed (delete folder qpkg ... not major but really annoying
... correct BUG generated by the 4.3.5 update (PATH not complete in shell session)
... Update preserve ALL Ubuntu env. scripts and user Home ...

Beta : 0.1
0.1 to reduce easy possibility to install it under the previous BETA
DON'T TRY to update from previous (with uninstall problem) Beta (1.0)
... Uninstall 1.0 following the recommendation in post : https://forum.qnap.com/viewtopic.php?f= ... 73#p679598

[What's new]
... NOW NO shared resource are "mounted" at initial start (YOU MUST ADD IT IF YOU WANT ... generally YES :mrgreen: ) ... so an uninstall can't remove your data
.. ... This is due to lack of QNAP control at QPKG Uninstall process (a simple test, 2 lines in shell, would have been enough to prevent (reduce drastically) any risk of data lost when removing a QPKG)
... NOW Ubuntu environment (16.04 LTS) is OUT of the QPKG folder ... so can't be removed if you don't use the provide (myHD command) remove all (with control, security and response (interactive mode))
... ... shell are provide out QPKG folder to remove manually Ubuntu environment if you remove QPKG by error or from QNAP WebUI
... NOW all generated QPKG (to launch myHD application) can be removed at myHD uninstall process
... ... BE PATIENT we use the qpkg tools from QNAP so request are queued to daemon and done after (more or less long)

[Install]
BE PATIENT, BE PATIENT AND wait for the log message (Admin Web UI) announcing that install (all phases) is complete
Install start as usual by installing myHD QPKG after download and unzip (myHD appear as an HD_Station application)
==== BUT for BETA ... I recommend to use a manual install (put myHD qpkg in /share/Public and run it in a console)
==== you will have a full view of QPKG install BUT also of the second stage (Ubuntu download and install)

AT END of installation process (very short)
FIRST RUN of myHD (automatic) start the download and install process for Ubuntu 16.04 environment (long)
... STANDARD install
... files are downloaded in a specific folder : /share/Public/myHD_delivery/
... delivery by part of 256Mo max, checksum control file, delivery of scripts
... the REAL delivery.tgz is recreated then tar file are extracted in QPKG folder
... then myHD install ONE application (test aka Xterm) QPKG hereafter (I use QNAP's qpkg_cli ... so delay exist between queuing the request and Q.T.S. execute it ... so BE PATIENT)
... ALTERNATE INSTALL (to don't wait (less wait) after QPKG install)
... BEFORE installing the QPKG ... download yourself the files needed BE SURE TO BE IN BINARY MODE
... ONE big complete file ... OR ... the part
... ... complete file (800Mo) : http://www.father-mande.ovh/Q/other//delivery_1604.tgz
... ... part file (256Mo max) : http://www.father-mande.ovh/Q/other//delivery_1604_aa then ab then ac then ad (change only the 2 last characters)
... if files are present and are correct (good checksum ) install use them in place of downloading them again ... (in case of problem the install download the correct file)
... shell script to download for you ... : https://www.father-mande.ovh/phpBB3/vie ... =27&t=1564

Then
... First run do an install of the test QPKG (it's a simple Xterm INSIDE myHD

Now you can :
... test MH_test to verify that the launcher works as expected (if not follow the debug process in myHD test post
... ... if all works as expected (Xterm will open)
... don't forgot to update/upgrade Ubuntu 16.04 (to get last version of Ubuntu applications (Kodi18, vlc, security patchs, libraries update, etc.)
myHD apt_upgrade_package
... ... some update / upgrade can require a restart of myHD (myHD restart) ... normaly you will be informed at end of upgrade ...

... add some shared resource to be accessible by myHD
==== R 0.1 due to an error in the shell Please temporary apply patch here : https://www.father-mande.ovh/phpBB3/vie ... 1329#p1427 for solving include_folder mechanism
for ex. :
myHD add_include_folder /share/Multimedia
THEN
restart myHD to use it
myHD restart
... Add existing QPKG you want to use :
for ex. :
myHD_qpkg install kodi18 (this request (queued) to QNAP QPKG manager to install it ... so can take some time)
THEN
test the qpkg (icon in Q.T.V. of HD_Station)
etc. etc.

A good idea for some BETA testers (more expert) is to use the manual install in a console to get a full trace of the process
... hereafter a trace on a TS-x53 Pro (Internet network for download less than 100Mbits)

Code: Select all

 # ./myHD_0.1.qpkg
Install QNAP package on TS-NAS ...
myHD.tgz
49218+1 records in
49218+1 records out
20081345 bytes (19.2MB) copied, 0.508772 seconds, 37.6MB/s
qinstall.sh
qpkg.cfg
Set QPKG information to /etc/config/qpkg.conf
Link service start/stop script: myHD.sh
/usr/bin/wget
--2018-08-08 14:13:28--  http://www.father-mande.ovh/Q/other//delivery_1604.list
Resolving www.father-mande.ovh (www.father-mande.ovh)... 46.105.57.169, 2001:41d0:301::20
Connecting to www.father-mande.ovh (www.father-mande.ovh)|46.105.57.169|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 311 [text/plain]
Saving to: ‘delivery_1604.list’

delivery_1604.list                        100%[====================================================================================>]     311  --.-KB/s   in 0s

2018-08-08 14:13:29 (19.5 MB/s) - ‘delivery_1604.list’ saved [311/311]

--2018-08-08 14:13:29--  http://www.father-mande.ovh/Q/other//delivery_scripts.tgz
Resolving www.father-mande.ovh (www.father-mande.ovh)... 46.105.57.169, 2001:41d0:301::20
Connecting to www.father-mande.ovh (www.father-mande.ovh)|46.105.57.169|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4227 (4.1K) [application/x-gzip]
Saving to: ‘delivery_scripts.tgz’

delivery_scripts.tgz                      100%[====================================================================================>]   4.13K  --.-KB/s   in 0s

2018-08-08 14:13:29 (177 MB/s) - ‘delivery_scripts.tgz’ saved [4227/4227]

delivery_scripts.tgz is good and downloaded
220abfeaa9fb5ec244633607e70ab75d  delivery_1604_aa
--2018-08-08 14:13:29--  http://www.father-mande.ovh/Q/other//delivery_1604_aa
Resolving www.father-mande.ovh (www.father-mande.ovh)... 46.105.57.169, 2001:41d0:301::20
Connecting to www.father-mande.ovh (www.father-mande.ovh)|46.105.57.169|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 268435456 (256M)
Saving to: ‘delivery_1604_aa’

delivery_1604_aa                          100%[====================================================================================>] 256.00M  11.2MB/s   in 23s

2018-08-08 14:13:52 (11.0 MB/s) - ‘delivery_1604_aa’ saved [268435456/268435456]

delivery_1604_aa is good and downloaded
12a68031bafe90293243dee2269a0a24  delivery_1604_ab
--2018-08-08 14:13:53--  http://www.father-mande.ovh/Q/other//delivery_1604_ab
Resolving www.father-mande.ovh (www.father-mande.ovh)... 46.105.57.169, 2001:41d0:301::20
Connecting to www.father-mande.ovh (www.father-mande.ovh)|46.105.57.169|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 268435456 (256M)
Saving to: ‘delivery_1604_ab’

delivery_1604_ab                          100%[====================================================================================>] 256.00M  10.5MB/s   in 24s

2018-08-08 14:14:17 (10.8 MB/s) - ‘delivery_1604_ab’ saved [268435456/268435456]

delivery_1604_ab is good and downloaded
948d4cec561e84812dc55157a8def765  delivery_1604_ac
--2018-08-08 14:14:18--  http://www.father-mande.ovh/Q/other//delivery_1604_ac
Resolving www.father-mande.ovh (www.father-mande.ovh)... 46.105.57.169, 2001:41d0:301::20
Connecting to www.father-mande.ovh (www.father-mande.ovh)|46.105.57.169|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 268435456 (256M)
Saving to: ‘delivery_1604_ac’

delivery_1604_ac                          100%[====================================================================================>] 256.00M  11.1MB/s   in 23s

2018-08-08 14:14:42 (11.1 MB/s) - ‘delivery_1604_ac’ saved [268435456/268435456]

delivery_1604_ac is good and downloaded
6acefa498ed16b5e144c3c2893479535  delivery_1604_ad
--2018-08-08 14:14:43--  http://www.father-mande.ovh/Q/other//delivery_1604_ad
Resolving www.father-mande.ovh (www.father-mande.ovh)... 46.105.57.169, 2001:41d0:301::20
Connecting to www.father-mande.ovh (www.father-mande.ovh)|46.105.57.169|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 25661264 (24M)
Saving to: ‘delivery_1604_ad’

delivery_1604_ad                          100%[====================================================================================>]  24.47M  11.0MB/s   in 2.2s

2018-08-08 14:14:45 (11.0 MB/s) - ‘delivery_1604_ad’ saved [25661264/25661264]

delivery_1604_ad is good and downloaded
delivery_1604.tgz is good and downloaded
Downloaded ... nothing to do ...
Downloaded and installed ... nothing to do ...
seems all run as well
Start list and install of all created QPKG
internal name:MH_test, path:/share/CACHEDEV1_DATA/.qpkg/myHD/myHD_qpkg/temp/MH_test_1.9.9.qpkg
[CLI] QPKG MH_test is queuing
get keys or generate them from HD_Station / get sound def.
exist so analyse if not changed ...
Keys are not changed
As requested /share/test is exclude
As requested /share/Web is exclude
Now start jchroot in background
/share/CACHEDEV1_DATA/.qpkg/myHD/bin/nohup: redirecting stderr to stdout
now start in background a survey to manage a clean exit
time to copy HDS keys 
# 
[Tests]
Try different command
Try including some folder to myHD
Try applications (install yours, test manually first and try create a QPKG with 2 files (see example and real) with the QPKG generator
Try changing language ...
etc. etc.
only limit is ... if the install works as expected ... :roll: :roll: :mrgreen:

[Know Bugs]
In some case default configuration) Vlc can stop working and stay running ... so disturb the others applications
... if you have run Vlc (I will try to send you the correct configuration for it) and fall in sound problem ... open a console and kill vlc (in Q.T.S. side or in myHD_root ... PID differ but program is the same (PID isolation))

[Download]

QPKG myHD 0.6.1 : https://www.father-mande.ovh/Q/qpkg/myHD_0.6.1.zip

Sorry this need lot of documentation (it's a complete / complex system by itself ... I will write it A.S.A.P. )

Have fun and thanks for your help.
Philippe.

Re: [myHD 0.1 BETA version] for tests ...

Posted: Sun Sep 02, 2018 3:44 am
by Sonn
Thank you for all your work.. :D

Re: [myHD 0.2 BETA version] for tests ...

Posted: Sun Sep 02, 2018 8:05 pm
by philippe
Hi,

Update.

Solve some bugs and support 4.3.5 change

Philippe.

Re: [myHD 0.2 BETA version] for tests ...

Posted: Sun Sep 02, 2018 11:51 pm
by Sonn
myHD_qpkg install kodi18...
does it tell you when its complete.... or should say done queuing?

Re: [myHD 0.2 BETA version] for tests ...

Posted: Mon Sep 03, 2018 2:21 am
by Hslansky
Sonn wrote:
Sun Sep 02, 2018 11:51 pm
myHD_qpkg install kodi18...
does it tell you when its complete.... or should say done queuing?
My experience is that there is no completed message, just check HD Station to see if it enabled.

Re: [myHD 0.2 BETA version] for tests ...

Posted: Mon Sep 03, 2018 2:24 am
by Hslansky
Philippe,
Can i install 0.2 over 0.1 or do I need to uninstall 0.1 first.

Thanks

Re: [myHD 0.2 BETA version] for tests ...

Posted: Mon Sep 03, 2018 3:23 am
by Sonn
So if I understand this correctly , with Kodi it will update itself with the latest version if you run the updater correct? If there is a update available...

NIce work on this Philippe :)

Re: [myHD 0.2 BETA version] for tests ...

Posted: Mon Sep 03, 2018 8:43 am
by philippe
Hi,
Hslansky wrote:
Mon Sep 03, 2018 2:24 am
Philippe,
Can i install 0.2 over 0.1 or do I need to uninstall 0.1 first.
Thanks
YES you can update from 0.1 and keep all your environment ... only myHD QPKG part is updated ... so you don't lost anything

Philippe.

Re: [myHD 0.2 BETA version] for tests ...

Posted: Mon Sep 03, 2018 8:45 am
by philippe
Hi,
Sonn wrote:
Mon Sep 03, 2018 3:23 am
So if I understand this correctly , with Kodi it will update itself with the latest version if you run the updater correct? If there is a update available...

NIce work on this Philippe :)
YES it's my target ... to don't have to redo works done by other (Kodi team itself) and to get update when they are available for Ubuntu 16.04 without extra works on it.

... I am a lazy :lol:

Philippe.
NB actually it's Beta delivery, but easy to return to nightly build or later to stable version ... (just add or change the PPA kodi team repository)

Re: [myHD 0.2 BETA version] for tests ...

Posted: Mon Sep 03, 2018 5:52 pm
by Sonn
philippe wrote:
Mon Sep 03, 2018 8:45 am
Hi,
Sonn wrote:
Mon Sep 03, 2018 3:23 am
So if I understand this correctly , with Kodi it will update itself with the latest version if you run the updater correct? If there is a update available...

NIce work on this Philippe :)
YES it's my target ... to don't have to redo works done by other (Kodi team itself) and to get update when they are available for Ubuntu 16.04 without extra works on it.

... I am a lazy :lol:

Philippe.
NB actually it's Beta delivery, but easy to return to nightly build or later to stable version ... (just add or change the PPA kodi team repository)
All running good here :) Great Job! Thank you!.....