Koozali.org: home of the SME Server

Contribs.org Forums => Koozali SME Server 10.x => Topic started by: umbi on November 16, 2021, 05:17:11 AM

Title: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 16, 2021, 05:17:11 AM

Hello

I have restored from V9.2 to V10 and i gave that server an internal ip for testing (only Localhost access).

Now at first i tried to login into webmail to check if the Mails are ben well migrated, but i cannot login with the users-accounts and correct passwors. Before restoring i had used webmail horde in fresh installed and updated V10 with admin user and admin password and it worket fine.

Code: [Select]

/sbin/e-smith/audittools/newrpmsLoading mirror speeds from cached hostfile
 * base: mirror.fra10.de.leaseweb.net
 * smeaddons: mirror.pialasse.com
 * smeos: mirror.pialasse.com
 * smeupdates: mirror.pialasse.com
 * updates: de.mirrors.clouvider.net
Extra-Pakete
GeoIP.x86_64                            1.6.12-9.el7.sme            @smecontribs
GeoIP-GeoLite-data.noarch               2018.06-7.el7.sme           @smecontribs
GeoIP-GeoLite-data-extra.noarch         2018.06-7.el7.sme           @smecontribs
awstats.noarch                          7.8-2.el7                   @smecontribs
fail2ban-sendmail.noarch                0.11.2-3.el7                @smecontribs
fail2ban-server.noarch                  0.11.2-3.el7                @smecontribs
libicu69.x86_64                         69.1-2.el7.remi             installed
perl-Data-Validate-IP.noarch            0.27-13.el7                 @smecontribs
perl-Geo-IP.x86_64                      1.45-1.of.el7               @smecontribs
php81-php.x86_64                        8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-bcmath.x86_64                 8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-cli.x86_64                    8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-common.x86_64                 8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-enchant.x86_64                8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-fpm.x86_64                    8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-gd.x86_64                     8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-imap.x86_64                   8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-intl.x86_64                   8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-ldap.x86_64                   8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-mbstring.x86_64               8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-mysqlnd.x86_64                8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-opcache.x86_64                8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-pdo.x86_64                    8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-pear.noarch                   1:1.10.13-1.el7.remi        @remi-safe
php81-php-pecl-xmlrpc.x86_64            1.0.0~rc2-3.el7.remi        @remi-safe
php81-php-pecl-zip.x86_64               1.20.0-1.el7.remi           @remi-safe
php81-php-process.x86_64                8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-snmp.x86_64                   8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-soap.x86_64                   8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-sodium.x86_64                 8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-tidy.x86_64                   8.1.0~rc6-1.el7.remi        @remi-safe
php81-php-xml.x86_64                    8.1.0~rc6-1.el7.remi        @remi-safe
php81-runtime.x86_64                    8.1-1.el7.remi              @remi-safe
phpMyAdmin.noarch                       5.1.0-1.el7.sme             @smecontribs
smeserver-awstats.noarch                1.4-3.el7.sme               @smecontribs
smeserver-crontab_manager.noarch        2.4-7.el7.sme               @smecontribs
smeserver-diskusage.noarch              0.2.0-5.el7.sme             @smecontribs
smeserver-fail2ban.noarch               9:0.1.18-19.el7.sme         @smecontribs
smeserver-hwinfo.noarch                 1.2-5.el7.sme               @smecontribs
smeserver-letsencrypt.noarch            0.5-17                      @smecontribs
smeserver-mod_dav.noarch                1.1-7.el7.sme               @smecontribs
smeserver-mod_deflate.noarch            1.2-4.el7.sme               @smecontribs
smeserver-phpmyadmin.noarch             4.0.10.2-11.el7.sme         @smecontribs
smeserver-qmHandle.noarch               1.4-16.el7.sme              @smecontribs
smeserver-remoteuseraccess.noarch       1.3-6.el7.sme               @smecontribs
smeserver-wbl.noarch                    0.5.0-5.el7.sme             @smecontribs
smeserver-webhosting.noarch             0.0.9-13.el7.sme            @smecontribs

Code: [Select]

/sbin/e-smith/audittools/templates/etc/e-smith/templates-custom/70ZendIonCube: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/VirtualHosts40ACME: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/20LoadModule80PHP: MANUALLY_ADDED, OVERRIDE
/etc/e-smith/templates-custom/etc/dar/DailyBackup.dcf/41go-into: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/crontab/.91_Update_GeoIP_db.swp: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/php.ini/70ZendIonCube: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/php.ini/.php.ini.swp: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/php.ini/12phptmpfolder: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/squid/squid.conf/75SizeOfCache: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/squid/squid.conf/72MaxHeaderSize: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/squid/squid.conf/70StoreAvgObjectSize: MANUALLY_ADDED, OVERRIDE
/etc/e-smith/templates-custom/etc/squid/squid.conf/71MaxCacheTime: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/home/e-smith/ssl.crt: MANUALLY_ADDED, OVERRIDE


Is that bug known ? i found nothing similar with the search function.  (only the one who had luck with changing password, what wasn't working for me.

Is the error maybe because i added the etc/dehydrated to the dar backup?

Thank you

Umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 16, 2021, 10:00:17 AM

As your English is not very good you should have stuck to the simplest back up using USB.

We now have multiple threads with multiple issues and it is not going to be very easy to help you.

First thing is read this especially #2 :

https://forums.contribs.org/index.php/topic,54433.0.html

That will probably fix some things.

Several of your old php templates will not work and will need to be reconfigured for PHP-FPM

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 16, 2021, 01:59:28 PM

Hi ReetP

Thank you for your answer.

The topic in the link says "if you cannot access to server-manager" but server-manager works fine.
I try to work up the in the link listed steps on this evening and report here again to be a help for each other with same issues.

I appreciate your help and send you the best wishes.

Umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 16, 2021, 02:15:24 PM

Quote

i tried to login into webmail to check if the Mails are ben well migrated, but i cannot login with the users-accounts and correct passwors

Please more carefully, and not quite so literally - webmail is PHP powered:

#2 after I restore my data from my SME9 to my SME10 , I can not access to the web server / server-manager - this includes any other PHP/web based system like webmail

Remove your templates-custom for httpd. There are chances you have a fragment with reference to php values for php module for httpd. We do not use this anymore, and it creates a fatal error on start of httpd

Quote

/etc/e-smith/templates-custom/etc/php.ini/70ZendIonCube: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/php.ini/.php.ini.swp: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/php.ini/12phptmpfolder: MANUALLY_ADDED, ADDITION

Almost certainly this is related to your custom templates - please check you logs as they will most likely contain the answers - /var/log/httpd/error_log etc

Half of those templates are wrong anyway so remove them and try again.

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 21, 2021, 02:27:35 PM

Dear ReetP

Thank you verry much for your reply.

I will try following command in migrated V10 Server:

mv /etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf /root/
 systemctl restart httpd-e-smith.service

post-upgrade
reboot

If i have understood right, that command will restore the httpd to default template and i sould be able to connect again by user / userpw to webmail.

After that i can reconfigure the i_bays by server-manager to the required settings

I will send an update as soon as possible, to repport success or fail.

Umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 21, 2021, 02:35:08 PM

I'd run signal-event webapps-update or console-save or post-upgrade/reboot to make sure all the right templates & services are restarted.

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 21, 2021, 10:58:04 PM

Hello ReetP

As promised i give here my feedback:

The command

mv /etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf /root/
 systemctl restart httpd-e-smith.service

did not worked for me.

When i go to httpd logs, i see:

[ssl:warn] [pid 3680] AH01909: ECC certificate configured for mydomain.com:443 does NOT include an ID which matches the server name

this error is repeated by each domain.

Allso found in the logs:
Init: Name-based SSL virtual hosts only work for clients with TLS server name indication support (RFC 4366)

regards

Umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 22, 2021, 02:37:52 AM

Did you use letsencrypt?

Have copied over your old certificates?

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 22, 2021, 06:06:01 PM

Hello ReetP

Yes i added the letsencrypt folder to the backups.

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 22, 2021, 06:14:30 PM

So where did this come from?

Quote

ECC certificate configured

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 23, 2021, 01:09:07 AM

I don't know :-(

Maybe i should uninstall letsencrypt and crt files and work with server ssl first as i use the test machine in localhost only at the moment?

I apologize - Im a little lost....

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: TerryF on November 23, 2021, 05:37:12 AM

Quote from: umbi on November 23, 2021, 01:09:07 AM

I apologize - Im a little lost....

na..hang in there mate..its just a test setup, its what they are for, use em and delete em..

are yopu using a VM or real hardware, VM so muche easier, snapshots and what not...anyway..

perhaps, have a cool bevvy and plan next assasult, install a clean sme10, do your restore of the sme9, reinstall contribs, see what transpires, still got problems maybe just use a basic sme9 backup without extra stuff and go to trouble of redoing letsencrypt setup..there are other paths as well...

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 23, 2021, 09:56:27 AM

Should be able to force an update of your certificates using

Code: [Select]

dehydrated -c -x
If not read the wiki on how to reset your certicates.

https://wiki.koozali.org/Letsencrypt

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 23, 2021, 09:59:43 AM

Also note this won't work

Code: [Select]

mv /etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf /root/
 systemctl restart httpd-e-smith.service

Because you have not expanded/regenerated any templates. Jusr moved the templates and restarted httpd.

Use signal-event webapps-update or console-save or post-upgrade/reboot.

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 23, 2021, 06:36:40 PM

Hi ReetP
Hi TerryF

First thank you for you patience with me :-)

ReetP you're telling me to regenerate the letsencrypt certificates - i can't because i have the productive SME 9.2 still on public IP and the Test V10 computer still on localhost working. So if i havent a port-forward to the test V10 machin an regeneration of certificates can't be done.

Uninstalling letsencrypt and working by openssl given from V10 should be the right way for me.
After all is working fine i can go to forward the ports to the new V10 machin, install letsencrypt and generate new certificates. Can you confirm that way can work?

 TerryF:  im not using VMW its a real machin...   2 machins  1x V9.2 still productive with hurting blocked IMAP access and 1x V10 in testmode migrated only in intranet mode (not reachable from outside).

Wich you much health guys and thank you again

greez
umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 23, 2021, 10:33:10 PM

Quote from: umbi on November 23, 2021, 06:36:40 PM

Hi ReetP
Hi TerryF

First thank you for you patience with me :-)

No worries.

Quote

ReetP you're telling me to regenerate the letsencrypt certificates - i can't because i have the productive SME 9.2 still on public IP and the Test V10 computer still on localhost working. So if i havent a port-forward to the test V10 machin an regeneration of certificates can't be done.

Uninstalling letsencrypt and working by openssl given from V10 should be the right way for me.
After all is working fine i can go to forward the ports to the new V10 machin, install letsencrypt and generate new certificates. Can you confirm that way can work?

Yes - follow the wiki to revert to the Self Signed cert - you can then run letsencrypt once you have migrated.

https://wiki.koozali.org/Letsencrypt#Certificate_Errors

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: TerryF on November 23, 2021, 11:42:08 PM

Quote from: umbi on November 23, 2021, 06:36:40 PM

Uninstalling letsencrypt and working by openssl given from V10 should be the right way for me.
After all is working fine i can go to forward the ports to the new V10 machin, install letsencrypt and generate new certificates. Can you confirm that way can work?

A plan, always have a plan, it might be crap but at least you know how you got in it :-)

Quote

TerryF:  im not using VMW its a real machin...   2 machins  1x V9.2 still productive with hurting blocked IMAP access and 1x V10 in testmode migrated only in intranet mode (not reachable from outside).

You should get yourself an old cast aside desktop PC, plenty of RAM and put proxmox on and have some fun, sooths the soul in times of stress :-)

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 25, 2021, 02:29:47 AM

Hi Guys

I promised you an update and here it is:

1.) on the v10 Test Server i removed letsencrypt ->  server-manager allso no more reachable
2.) i deinstalled and reinstalled the sme openssl -> server-manager AND webmail works again perfect  :lol:

I think ReetP's advice to regenerate letsencrypt's certificate with dehydrate -c should then fix the problem in productive mode.

For now in testing use in the V10 the selfsigned certificate is OK for me.


Now another question: 
Do i have any chance to connect  to my intranet testserver by IMAP client on a internal ip instead of mail.myserver.com:993  ?  I tried by 192.168.x.x  but it looks as the sme V10 Testserver doesnt allow a such connection. The same is i want to test the websites allso in intranet mode. This maybe i can solve over proxy resp. gateway settings in browser.


Btw, big respect what you are doing here.

I give my word that after successfull migration and stable working of my V10 in productive mode, i will push the donate button.

stay healthy and thank you again !

umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: TerryF on November 25, 2021, 04:40:13 AM

Quote from: umbi on November 25, 2021, 02:29:47 AM

Hi Guys

I promised you an update and here it is:

1.) on the v10 Test Server i removed letsencrypt ->  server-manager allso no more reachable
2.) i deinstalled and reinstalled the sme openssl -> server-manager AND webmail works again perfect  :lol:

I think ReetP's advice to regenerate letsencrypt's certificate with dehydrate -c should then fix the problem in productive mode.

For now in testing use in the V10 the selfsigned certificate is OK for me.


Now another question: 
Do i have any chance to connect  to my intranet testserver by IMAP client on a internal ip instead of mail.myserver.com:993  ?  I tried by 192.168.x.x  but it looks as the sme V10 Testserver doesnt allow a such connection. The same is i want to test the websites allso in intranet mode. This maybe i can solve over proxy resp. gateway settings in browser.

Firstly, rememeber dehydrated -c just generates  a test, dehydrated -c -x  does the real deal, READ the wiki carefully all explained there

Re imap, simple answer Yes

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on November 25, 2021, 06:49:58 PM

Hello TerryF

Thx for your reply.

Yes for me it's clear that i first put in dehydrate -c   and when its runned over without fails, i'll repeat it with -c -x to regenerate the masterkey.

Re imap, simple answer Yes

You can make me the day sweeter if you can give me hint :-)

greez
umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on November 25, 2021, 07:01:30 PM

Quote

i will push the donate button.

You don't have to wait - you can do that ANY time :-)

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: TerryF on November 25, 2021, 10:58:55 PM

Quote from: umbi on November 25, 2021, 06:49:58 PM

Re imap, simple answer Yes
You can make me the day sweeter if you can give me hint :-)

I will have to get it up and going on a test VM to validate my hint..VMs, use em, burn em, blow em up doesnt hurt anything just increases ones knowledge base

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on December 24, 2021, 02:53:29 PM

Hi there

another phenomena i saw in the last weeks :
After migration of v9 datas, the V10 doesnt show me any V10 Updates anymore.

It doesnt mather how i configure the Updatesettings in server-manager.

Is that a known issue or do i something wrong?

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: TerryF on December 24, 2021, 11:27:13 PM

Quote from: umbi on December 24, 2021, 02:53:29 PM

Is that a known issue or do i something wrong?

Yes, Suspect number 1, you are not doing something :-)

Have you configured updates in the SM, or have you been playing and disabled them?

What is result of a straight # yum update  from a terminal? maybe you have installed all and any updates already?

Now I am off to have xmas lunch with family..have fun

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on February 14, 2022, 01:19:22 AM

http://mirror.de-labrusse.fr/smeserver/7/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Anderer Spiegelserver wird versucht.
To address this issue please refer to the below wiki article

i have deactivated labrusse.fr in SM and it makes updates now.

The only thing he hangs up here since 1 hour:

Feb 14 01:26:40 server esmith::event[22868]: S80ldap-update=action|Event|temp|Action|S80ldap-update|Start|1644798399 933712|End|1644798400 173908|Elapsed|0.240196

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on February 14, 2022, 01:24:23 AM

That repo is no longer valid.

Remove it.

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on February 14, 2022, 02:33:44 AM

yes but he hangs now here:

 Migrating existing database wbl
 Creating temporary event 'temp' and populating it...
  Adding actions to execute
  Adding templates to expand
  Adding services to adjust
 Executing signal-event temp ...........


Feb 14 01:26:40 server esmith::event[22868]: S80ldap-update=action|Event|temp|Action|S80ldap-update|Start|1644798399 933712|End|1644798400 173908|Elapsed|0.240196


After a reboot he passed the updates...  strange

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on February 14, 2022, 03:00:44 AM

Can you confirm it is fixed?

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on February 14, 2022, 03:05:50 AM

It was fixed as i forced a reboot while the endless loop mentioned in my last post.

1.) i have rebootet the server in SM
2.) i went to software updates in SM and it was at the same point but that time it passed
3.) i pushed the reconfigure button

All seems to be ok now

thx
hope you allso can get a little bit sleep tonight

greez
umbi

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: ReetP on February 14, 2022, 03:24:22 AM

Cool. Glad it is ok.

Tonight? Sleep? It's Super Bowl.... !!

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: TerryF on February 14, 2022, 08:48:40 AM

Quote from: umbi on November 23, 2021, 06:36:40 PM

Hi ReetP
Hi TerryF

First thank you for you patience with me :-)

All been there mate :-)

Quote

Uninstalling letsencrypt and working by openssl given from V10 should be the right way for me.
After all is working fine i can go to forward the ports to the new V10 machin, install letsencrypt and generate new certificates. Can you confirm that way can work?

Definetly...

Enjoy, keep, safe

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on May 04, 2022, 08:14:09 PM

Hi togheter

Is there a easy way to copy single mail user accounts from a productive V9.2  to an new installed V10 server?

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: Jean-Philippe Pialasse on May 05, 2022, 02:56:30 AM

rsync
tar

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on June 05, 2022, 09:15:47 PM

Hi

For you meight be easy for me not.

i have

1.) a complete smeserver.tgz  file on a windows pc
and
2.) a backup set  with .dar   files  on a CIFs NAS

how can i restore selected user Accounts to an existing new V10 Installation - explained for a lamer ;-) ?

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: Jean-Philippe Pialasse on June 05, 2022, 10:36:03 PM

for 1 first google result https://unix.stackexchange.com/questions/35311/how-do-you-extract-a-single-folder-from-a-large-tar-gz-archive


for 2 simply follow the manual, and use the selective restore option after setting manually the workstation backup to be able to restore. 


and again easiest way would be to use rsync to sync the content of user subfolder from old sme9 to new sme10

Title: Re: After restore from V9.2 to V10 horde Login no more possible
Post by: umbi on June 05, 2022, 11:41:57 PM

Salut Jean-Philippe

"for 2 simply follow the manual, and use the selective restore option after setting manually the workstation backup to be able to restore.  "

It doesnt work, i shwos an error.

*Gezielte Wiederherstellung einzelner Dateien aus dem Workstation Backup
Fehler beim Lesen der Dateien von : 0

If you restore from Koozali SME Server 9 or before, pay attention that some folders in the system are now symlinks. Basic backup configuration does not include /bin, /lib, /lib64, /sbin, /var/lock and /var/run. If you have added them for files in their subdirectories, we will prevent the restoration of those folders to prevent dar from replacing those symlinks and leave the system unusable. Those additions are, however, not recommended as they are at risk to overwrite files provides by rpms.
Dateien für Wiederherstellung auswählen:*

or:

Targeted recovery of individual files from the workstation backup
Backup directory is already included

To Rsync:

the first issue i have to install resync to SME 9.2 it doesnt find the repos. So i installed rsync over servermanager.


If you have a little time can you please list me a 1:1 step how to ?