Koozali.org: home of the SME Server

Loosing internet connection after post-upgrade of server

Offline beast

  • *
  • 238
  • +0/-0
Loosing internet connection after post-upgrade of server
« on: July 23, 2021, 08:39:55 AM »
Hi

I have randomly seen that I loose the internet connection of the server and I am beginning to understand why.

I have to reconfigure the server from the server console to get the internet back.

Not a good behavior of a server

Here last time I installed git and made a

signal-event post-upgrade; signal-event reboot

And I did not have internet connection again.

I am unable to see anything in the logs about this.

I have followed the relevant section in this thread: https://forums.contribs.org/index.php/topic,54433.0.html

I had many of the problems reported there, but something is still missing?

/Benny

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #1 on: July 23, 2021, 09:44:19 AM »
While you may have detailed in the past, my memory is fading, what is your setup
--
qui scribit bis legit

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #2 on: July 23, 2021, 02:43:02 PM »
While you may have detailed in the past, my memory is fading, what is your setup

Just a "standard" new server with SSD in Raid 1. Restore from old SME9 USB disk and then installation of needed contribs etc.

Have investigated this a bit and I think we have 2 different bugs/problems. One is related to git install as there is a syntax error in the httpd.conf file after installation: Rewritelog under a git section. I will report this later.

Then there is the internet connection problem.

After "signal-event post-upgrade; signal-event reboot" It is not possible to ping the server. The server can ping an outside IP but not a domain name. If I reconfigure in the server console it has no effect unless I modify the last dns section and enter something for example 1.1.1.1. Then it works again and I can reconfigure again and remove the 1.1.1.1 and it continue to work fine.

One more "signal-event post-upgrade; signal-event reboot" and all the problems are back - what to do here?


Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #3 on: July 23, 2021, 11:42:41 PM »
You have installed test software on a production machine?

You already opened a query on DNS.

https://forums.contribs.org/index.php/topic,54549.0.html

You then try test software only intended for a test machine.

You are just confusing things. Stick with one issue and understand/resolve it before trying the next.

And use a test machine for test software as it is liable to break your server.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #4 on: July 24, 2021, 12:10:51 AM »
rpm -qa | grep samba

Offline ReetP

  • *
  • 3,722
  • +5/-0
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #6 on: July 24, 2021, 12:15:05 AM »
Uh oh.....
smells like smeserver-samba spirit

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #7 on: July 24, 2021, 12:24:22 AM »
smells like smeserver-samba spirit

:lol:

So bad....
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #8 on: July 24, 2021, 06:42:37 AM »
You have installed test software on a production machine?

You already opened a query on DNS.

https://forums.contribs.org/index.php/topic,54549.0.html

You then try test software only intended for a test machine.

You are just confusing things. Stick with one issue and understand/resolve it before trying the next.

And use a test machine for test software as it is liable to break your server.

It is not a production machine. I have 2 identical hardware. One is running as a production server with SME9. The other I use for trying out a possible upgrade. So, I have not installed test software on the production server. I normally use the second server as a Affa backup server. I have not stated anywhere that this is a problem on a production server?

https://forums.contribs.org/index.php/topic,54549.0.html was just a question and not related to a problem? This is the thread with a problem and the problem was there from the beginning after the restore from USB disk. I have tried this 3 times now.

I am not trying to confuse things. Just trying to help this server software to be as good as possible for both my own selfish reason's and for everybody else's benefits. It is not helping that I am being told that I confuse things and I must stick with one issue etc. because I do try to understand/resolve before taking the next step. If this is related to the fact that I mentioned git I am sorry about that as it was just the step I took when I discovered the problem again.
« Last Edit: July 24, 2021, 08:02:33 AM by beast »

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #9 on: July 24, 2021, 07:52:20 AM »
rpm -qa | grep samba

e-smith-samba-2.6.0-23.el7.sme.noarch
samba-common-libs-4.10.16-15.el7_9.x86_64
samba-client-4.10.16-15.el7_9.x86_64
samba-common-4.10.16-15.el7_9.noarch
samba-4.10.16-15.el7_9.x86_64
samba-client-libs-4.10.16-15.el7_9.x86_64
samba-libs-4.10.16-15.el7_9.x86_64
samba-common-tools-4.10.16-15.el7_9.x86_64

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #10 on: July 24, 2021, 11:36:45 AM »
It is not a production machine. I have 2 identical hardware. One is running as a production server with SME9. The other I use for trying out a possible upgrade. So, I have not installed test software on the production server. I normally use the second server as a Affa backup server. I have not stated anywhere that this is a problem on a production server?

No, and that is because you haven't actually really stated anything clearly. A prerequisite when trying to to debug stuff.

I wrote this a long time ago orientated to Rocket.Chat but you can see how to write well documented questions.

https://gist.github.com/reetp/a66149d5f060f260643a353ca7067a98

Also see this which you can use for testing:

https://wiki.koozali.org/SME_Server:Documentation:QA:Verification

With your three posts here and then your gitweb post it is all pretty confusing.

Quote
I am not trying to confuse things. Just trying to help this server software to be as good as possible for both my own selfish reason's and for everybody else's benefits. It is not helping that I am being told that I confuse things and I must stick with one issue etc. because I do try to understand/resolve before taking the next step. If this is related to the fact that I mentioned git I am sorry about that as it was just the step I took when I discovered the problem again.

Yes. As I have said. Stick to ONE issue at a time. You have an issue with DNS and then and you try and add gitweb, which is still testing.

You then have two or three threads and no one knows if they are separate issues or linked. Is DNS causing gitweb issues, or vice versa or are they totally separate?

I'm not trying to be critical, just trying to get you to be methodical or you will confuse the many readers of these threads.

...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #11 on: July 24, 2021, 12:15:48 PM »
ReetP - I will not comment on this issue any more. I do my best but it is clearly not good enough and for that I am sorry.

The process have been that I have tried to upgrade to SME10 and along the way I have been having problems and this is the only way they are related. It would be difficult to collect it all into a single issue as they are not related and for some of them I would be more or less unable to continue the upgrade process and find new problems.
« Last Edit: July 24, 2021, 12:53:45 PM by beast »

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #12 on: July 24, 2021, 03:46:39 PM »
Just to be more clear

The problem is there right after the install of SME10 and a restore from USB disk from the old SME9 server.

/Benny

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #13 on: July 24, 2021, 04:08:59 PM »
Just to be more clear

The problem is there right after the install of SME10 and a restore from USB disk from the old SME9 server.

/Benny

I did not know that before now as I just verified it by performing the procedure.
« Last Edit: July 24, 2021, 04:19:45 PM by beast »

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #14 on: July 24, 2021, 09:29:07 PM »
1- did you do post-upgrade reboot after restoring before that? this is neeeded in order to have your services restored. 


2- can you elaborate the no connectivity.
what returns ifconfig? are you able to ping an external ip ? are you able to resolve a domain  dig google.com?

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #15 on: July 25, 2021, 07:27:03 AM »
1- did you do post-upgrade reboot after restoring before that? this is neeeded in order to have your services restored. 

Not by typing it on the command line. Here last time during GUI installation I make a internet connection by setting up the network (dhcp client). The server ask for a reboot at the end of the GUI installation. It reboot and at the end of the boot process it ask for a possible restore disk that I accept. I disconnect the internet cable during the restore as I do not what any conflicts with the current running server. After some hours and another automatic reboot/reconfiguration I then go to the server console directly on the server to disable DHCP and give it another name and IP so it will not conflict with the current server and reconnect the network cable. Then I have the problem. I have tried this in other combinations, but do not remember all details any more. An update at this point on the command line do not improve on the situation and also not possible because of the situation (I have to reconfigure dns first).

NB: I also have to remove template files in httpd.conf to make httpd work and disable nut as I have a UPS running on the old server (gives errors on the command line and console and is quite annoying)

2- can you elaborate the no connectivity.
what returns ifconfig? are you able to ping an external ip ? are you able to resolve a domain  dig google.com?

I am as reported able to ping 8.8.8.8 but not google.com. When I ping a domain name it return with an error text after a long timeout that there is a temporary error in the domain name lookup (translated from Danish). From the outside (another pc) I am not able to ping the ip of the server even on the same subnet. ifconfig looks normal to me. I had to reconfigure dns to get access not to retype everything.

Code: [Select]
enp4s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.11.12  netmask 255.255.255.0  broadcast 192.168.11.255
        ether 30:85:a9:3c:51:6c  txqueuelen 1000  (Ethernet)
        RX packets 4567  bytes 872505 (852.0 KiB)
        RX errors 0  dropped 3237  overruns 0  frame 0
        TX packets 69  bytes 10194 (9.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 217  bytes 14676 (14.3 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 217  bytes 14676 (14.3 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #16 on: July 25, 2021, 09:45:55 AM »
After some hours and another automatic reboot/reconfiguration I then go to the server console directly on the server to disable DHCP and give it another name and IP so it will not conflict with the current server and reconnect the network cable. Then I have the problem.

Which is to be expected.

What is IP of the old SME9 server?

IP of the new SME10 server is  192.168.11.12

What is the gateway IP?

--
qui scribit bis legit

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #17 on: July 25, 2021, 11:22:14 AM »
Which is to be expected.

What is IP of the old SME9 server?

IP of the new SME10 server is  192.168.11.12

What is the gateway IP?

Old SME9 server is 192.168.11.11
Gateway is 192.168.11.1

192.168.11.12 is the same IP as the server had when it was running as a Affa backup sever but I have also tried with other IP

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #18 on: July 25, 2021, 11:27:30 AM »
Old SME9 server is 192.168.11.11
Gateway is 192.168.11.1

192.168.11.12 is the same IP as the server had when it was running as a Affa backup sever but I have also tried with other IP

DHCP range is 100 to 200

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #19 on: July 25, 2021, 12:57:27 PM »
i see dns resolution is an issue.

i see it can ping to external ip. so network connectivity is not an issue, the issue is dhcp resolution. 

so my guess and only a guess because you did not tell us yet at the 2nd page of discussion : you set the ip being 11.12. the gateway being 11.1 and what do you set as dns server first ?


also from my understanding you are rebooting and then pluging the cable ?  have you tried a simple reboot without reconfiguring after pluging the cable ?

could you do

systemctl status -l dnscache
systemctl status -l dnscache.forwarder
systemctl status -l masq
systemctl status -l network

iptables -L

just after pluging back the network cable after initial configuration to new ip and reboot

then try

systemctl restart network masq dnscache dnscache.forwarder
« Last Edit: July 25, 2021, 01:02:11 PM by Jean-Philippe Pialasse »

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #20 on: July 25, 2021, 01:01:41 PM »
so my guess and only a guess because you did not tell us yet at the 2nd page of discussion : you set the ip being 11.12. the gateway being 11.1 and what do you set as dns server first ?

At first I do not set anything in dns and it does not work. Then I have to set it to for example 1.1.1.1 in the console and the network is working again. Then I can reconfigure it to an empty string and it keeps working. First time I make a post-upgrade of server it does not work again and I have to make the server console procedure again.

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #21 on: July 25, 2021, 01:09:32 PM »
At first I do not set anything in dns and it does not work. Then I have to set it to for example 1.1.1.1 in the console and the network is working again. Then I can reconfigure it to an empty string and it keeps working. First time I make a post-upgrade of server it does not work again and I have to make the server console procedure again.

DNS entry is empty on the old server and also empty at the first reconfiguration to disable dhcp and change ip.

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #22 on: July 25, 2021, 02:47:24 PM »
also from my understanding you are rebooting and then pluging the cable ?  have you tried a simple reboot without reconfiguring after pluging the cable ?

could you do

systemctl status -l dnscache
systemctl status -l dnscache.forwarder
systemctl status -l masq
systemctl status -l network

iptables -L

just after pluging back the network cable after initial configuration to new ip and reboot

then try

systemctl restart network masq dnscache dnscache.forwarder

I had to do a post-upgrade to get the machine into the problem condition as I do not have time right now to do a full install/restore.

BTW: Will not be on location the next 3 days

systemctl restart network masq dnscache dnscache.forwarder did not help - at least still unable to ping google.com

● networking.service - Network management for Koozali SME Server, using old sysvinit script
   Loaded: loaded (/usr/lib/systemd/system/networking.service; enabled; vendor preset: enabled)
   Active: active (exited) since søn 2021-07-25 14:24:16 CEST; 5min ago
  Process: 1385 ExecStart=/etc/rc.d/init.d/network start (code=exited, status=0/SUCCESS)
 Main PID: 1385 (code=exited, status=0/SUCCESS)
   Memory: 4.0K
   CGroup: /system.slice/networking.service

jul 25 14:24:10 beastserver2.beast2.dk systemd[1]: Starting Network management for Koozali SME Server, using old sysvinit script...
jul 25 14:24:11 beastserver2.beast2.dk network[1385]: Sætter loopback-grænsefladen i drift:  [  O.k.  ]
jul 25 14:24:16 beastserver2.beast2.dk network[1385]: Sætter grænseflade enp4s0 i drift:  [  O.k.  ]
jul 25 14:24:16 beastserver2.beast2.dk systemd[1]: Started Network management for Koozali SME Server, using old sysvinit script.

● masq.service - masq, the Koozali SME Server firewall script
   Loaded: loaded (/usr/lib/systemd/system/masq.service; disabled; vendor preset: disabled)
   Active: active (exited) since søn 2021-07-25 14:24:10 CEST; 4min 46s ago
  Process: 1219 ExecStart=/etc/rc.d/init.d/masq start (code=exited, status=0/SUCCESS)
  Process: 1209 ExecStartPre=/sbin/e-smith/service-status masq (code=exited, status=0/SUCCESS)
 Main PID: 1219 (code=exited, status=0/SUCCESS)
   Memory: 0B
   CGroup: /system.slice/masq.service

jul 25 14:24:09 beastserver2.beast2.dk systemd[1]: Starting masq, the Koozali SME Server firewall script...
jul 25 14:24:09 beastserver2.beast2.dk service-status[1209]: masq status not enabled in configuration db.
jul 25 14:24:10 beastserver2.beast2.dk masq[1219]: Enabling IP masquerading: done
jul 25 14:24:10 beastserver2.beast2.dk systemd[1]: Started masq, the Koozali SME Server firewall script.


● dnscache.forwarder.service - dnscache.forwarder,
   Loaded: loaded (/usr/lib/systemd/system/dnscache.forwarder.service; enabled; vendor preset: enabled)
   Active: active (exited) since søn 2021-07-25 14:24:10 CEST; 4min 25s ago
  Process: 1461 ExecStart=/usr/bin/sv u /service/dnscache.forwarder (code=exited, status=0/SUCCESS)
  Process: 1351 ExecStartPre=/sbin/e-smith/service-status dnscache.forwarder (code=exited, status=0/SUCCESS)
 Main PID: 1461 (code=exited, status=0/SUCCESS)
   Memory: 0B
   CGroup: /system.slice/dnscache.forwarder.service

jul 25 14:24:10 beastserver2.beast2.dk systemd[1]: Starting dnscache.forwarder,...
jul 25 14:24:10 beastserver2.beast2.dk systemd[1]: Started dnscache.forwarder,.

● dnscache.service - dnscache,
   Loaded: loaded (/usr/lib/systemd/system/dnscache.service; enabled; vendor preset: enabled)
   Active: active (exited) since søn 2021-07-25 14:24:10 CEST; 3min 53s ago
  Process: 1486 ExecStart=/usr/bin/sv u /service/dnscache (code=exited, status=0/SUCCESS)
  Process: 1372 ExecStartPre=/sbin/e-smith/service-status dnscache (code=exited, status=0/SUCCESS)
 Main PID: 1486 (code=exited, status=0/SUCCESS)
   Memory: 0B
   CGroup: /system.slice/dnscache.service

jul 25 14:24:10 beastserver2.beast2.dk systemd[1]: Starting dnscache,...
jul 25 14:24:10 beastserver2.beast2.dk systemd[1]: Started dnscache,.

Chain INPUT (policy DROP)
target     prot opt source               destination         
state_chk  all  --  anywhere             anywhere           
local_chk  all  --  anywhere             anywhere           
denylog    all  --  224.0.0.0/4          anywhere           
denylog    all  --  anywhere             224.0.0.0/4         
InboundICMP  icmp --  anywhere             anywhere           
denylog    icmp --  anywhere             anywhere           
InboundTCP  tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN
denylog    tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN
InboundUDP  udp  --  anywhere             anywhere           
denylog    udp  --  anywhere             anywhere           
denylog    all  --  anywhere             anywhere           

Chain FORWARD (policy DROP)
target     prot opt source               destination         
state_chk  all  --  anywhere             anywhere           
SMTPProxy  tcp  --  anywhere             anywhere             tcp dpt:smtp
local_chk  all  --  anywhere             anywhere           
ForwardedTCP  tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN
ForwardedUDP  udp  --  anywhere             anywhere           
denylog    all  --  anywhere             anywhere           

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination         
denylog    all  --  224.0.0.0/4          anywhere           
denylog    all  --  anywhere             224.0.0.0/4         
ACCEPT     all  --  anywhere             anywhere           

Chain ForwardedTCP (1 references)
target     prot opt source               destination         
ForwardedTCP_1  tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN
denylog    tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN

Chain ForwardedTCP_1 (1 references)
target     prot opt source               destination         

Chain ForwardedUDP (1 references)
target     prot opt source               destination         
ForwardedUDP_1  udp  --  anywhere             anywhere           
denylog    udp  --  anywhere             anywhere           

Chain ForwardedUDP_1 (1 references)
target     prot opt source               destination         

Chain InboundICMP (1 references)
target     prot opt source               destination         
InboundICMP_1  icmp --  anywhere             anywhere           
denylog    icmp --  anywhere             anywhere           

Chain InboundICMP_1 (1 references)
target     prot opt source               destination         

Chain InboundTCP (1 references)
target     prot opt source               destination         
InboundTCP_1  tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN
denylog    tcp  --  anywhere             anywhere             tcp flags:FIN,SYN,RST,ACK/SYN

Chain InboundTCP_1 (1 references)
target     prot opt source               destination         

Chain InboundUDP (1 references)
target     prot opt source               destination         
InboundUDP_1  udp  --  anywhere             anywhere           
denylog    udp  --  anywhere             anywhere           

Chain InboundUDP_1 (1 references)
target     prot opt source               destination         

Chain SMTPProxy (1 references)
target     prot opt source               destination         

Chain SSH_Autoblock (0 references)
target     prot opt source               destination         
SSH_Whitelist  tcp  --  anywhere             anywhere             tcp dpt:ssh state NEW
           all  --  anywhere             anywhere             recent: SET name: SSH side: source mask: 255.255.255.255
denylog    all  --  anywhere             anywhere             recent: CHECK seconds: 900 hit_count: 4 TTL-Match name: SSH side: source mask: 255.255.255.255

Chain SSH_Whitelist (1 references)
target     prot opt source               destination         
SSH_Whitelist_1  all  --  anywhere             anywhere           

Chain SSH_Whitelist_1 (1 references)
target     prot opt source               destination         

Chain denylog (15 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere           
DROP       all  --  anywhere             anywhere           
DROP       all  --  anywhere             anywhere           
DROP       all  --  anywhere             anywhere           
DROP       all  --  anywhere             anywhere           

Chain local_chk (2 references)
target     prot opt source               destination         
local_chk_1  all  --  anywhere             anywhere           

Chain local_chk_1 (1 references)
target     prot opt source               destination         

Chain state_chk (2 references)
target     prot opt source               destination         
ACCEPT     all  --  anywhere             anywhere             state RELATED,ESTABLISHED

« Last Edit: July 25, 2021, 02:48:56 PM by beast »

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #23 on: July 25, 2021, 02:57:23 PM »

also from my understanding you are rebooting and then pluging the cable ?  have you tried a simple reboot without reconfiguring after pluging the cable ?


Do not understand what to do differently here?

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #24 on: July 25, 2021, 06:59:37 PM »
this is a server. not a laptop.
it is intended to always be connected.
so network cable connected before you reboot, not after boot process has ended.

but from what i understand you have not actually tried to reinstall the server but only reconfigured it a couple of times with or without 1.1.1.1 as dns server?

and when no dns server is set no dns resolution is possible.

what is acting as router ? SME should be able to act as its own dns server unless something blocks him, or some situation prevent the solver to start (eg no network on boot).

also why not using the other SME as DNS solver or the router rather than 1.1.1.1?

what is the dns setting for your SME 9



Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #25 on: July 26, 2021, 09:25:59 AM »
this is a server. not a laptop.
it is intended to always be connected.
so network cable connected before you reboot, not after boot process has ended.

but from what i understand you have not actually tried to reinstall the server but only reconfigured it a couple of times with or without 1.1.1.1 as dns server?

and when no dns server is set no dns resolution is possible.

what is acting as router ? SME should be able to act as its own dns server unless something blocks him, or some situation prevent the solver to start (eg no network on boot).

also why not using the other SME as DNS solver or the router rather than 1.1.1.1?

what is the dns setting for your SME 9

I know it is a server and the network cable is only disconnected shortly during restore and until I get the server settings changed so it is not the same settings as the old server (conflict). One time I actually forgot it.

I have done a complete install of SME10 and restore from USB disk at least 4 times now. One time was with the text installer. Always with the same result of dsn problems.  I have now made a new backup disk just to make sure this is not the problem (but I really do not think so)

The old SME9 have a empty field for the dns setting. As far as I understand this means that it takes the dns settings from a root dns server somehow. There is also a short delay before internet is working in this case.

Both server are connected to a Linksys dual WAN router (244 I think). Never seen a problem with this and it works fine for the old SME9. So both servers are setup as server only.

The only reason I key in 1.1.1.1 is to get dns to work (I remove it again and I just have to key in something). The plan is to take the old server down when I have a working upgrade path.
« Last Edit: July 26, 2021, 09:28:45 AM by beast »

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #26 on: July 26, 2021, 10:27:17 AM »
Be careful with your network addressing.

Quote
    192.168.11.12 is the same IP as the server had when it was running as a Affa backup sever but I have also tried with other IP

Think you might have some sort of collision going on. Be very specific about exactly what IPs are used and how.

Quote
DHCP range is 100 to 200

Don't run DHCPD on both servers on the same network.

Quote
it takes the dns settings from a root dns server somehow

Yes SME is perfectly capable or resolving DNS by itself with no input from you, all things being equal and other parts of your network work correctly eg - firewall correctly set up.

You should not be modifying settings unless you absolutely know what you are doing, and why.

So with server only, and your router, have you allowed DNS traffic from the v10 server? You haven't mentioned that (or a lot of other information) so it is hard to know - I strongly suspect we only have half the story here which is why everyone is struggling to give you a solution.

============


Go back to basics. Do small steps. Check carefully and methodically and take lots of notes.

Install a clean SME v10 with some dummy settings, manual IP address, no dhcpd etc.

Make sure it all works before you do anything else. Reconfigure/reboot a few times. Do not do anything else until this all works happily.

Better check your v9 box too so we know what you are restoring.

/sbin/e-smith/audittools/newrpms
/sbin/e-smith/audittools/templates

Take down your v9 box and then restore the v10 so you do not get an IP clash.

Make sure there are no custom templates anywhere.

Reconfigure/reboot and test etc.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Loosing internet connection after post-upgrade of server
« Reply #27 on: July 26, 2021, 10:46:48 AM »
And to add to ReetP's post above:
The default root servers are here /etc/e-smith/templates/var/service/dnscache.forwarder/root/servers
from what I have observed if you set a corporate DNS server this will be replaced as the template is expanded.
resolve.conf points to the local IP for dns resolution via the dnscache service.
The config for this ends up here /var/service/dnscache.forwarder after the requisite templates are expanded.
Look here /etc/e-smith/templates/var/service/dnscache.forwarder/root/servers to see what the root name servers are configured as. With no DNS set it should have ~ 13 entries in it (from what I can see in the templates), when you set a DNS then that is what you should see in the root server file.
Try some traceroutes from the SME to see if DNS servers are allowed by your network.


That said, installing the dev samba packages stuff this up (as well as other things as has been previously mentioned).
A configuration from a previous sme install shouldn't break DNS. Others have numerous SME10 installs and haven't seen this issue, this suggests that there is something different about your system that isn't obvious to the people trying to help you. We need more clues :)
...

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #28 on: July 26, 2021, 02:03:07 PM »
Be careful with your network addressing.

Think you might have some sort of collision going on. Be very specific about exactly what IPs are used and how.

I am very careful and have a documented IP layout. 192.168.11.12 has always been in use for this machine, but I have tried with another IP just to be on the safe side.

Don't run DHCPD on both servers on the same network.

I do not run it on both servers. I only run it on the old SME9 server

Yes SME is perfectly capable or resolving DNS by itself with no input from you, all things being equal and other parts of your network work correctly eg - firewall correctly set up.

I know, but I have found out that I am able to make it work temporary by setting for example 1.1.1.1 as dns in the admin server console and then remove it again - do not know why. But post-update break it again so I guess that somewhere there is a "template" that state something wrongly for the server.

You should not be modifying settings unless you absolutely know what you are doing, and why.

I do not change anything. Only try out things to try and make it work again. It is very simple. I make a clean install of SME10. Upgrade from SME9 via USB disk backup. Reconfigure in admin server console not to have a conflict with the current server and then I have the issue

So with server only, and your router, have you allowed DNS traffic from the v10 server? You haven't mentioned that (or a lot of other information) so it is hard to know - I strongly suspect we only have half the story here which is why everyone is struggling to give you a solution.

I do not change any dns, firewall etc. settings. Also the old SME9 server is quite standard. I do not know what to tell you or what I might have left out. It does not work on the local network unless I make the admin server console hack.

I have not any settings in the Linksys router that will disallow dns traffic to the SME10. Only simple NAT forward settings to the SME9 server. It also work if I do the admin server console hack so in my view it can not be the router that is to blame.

Go back to basics. Do small steps. Check carefully and methodically and take lots of notes.

Install a clean SME v10 with some dummy settings, manual IP address, no dhcpd etc.

Make sure it all works before you do anything else. Reconfigure/reboot a few times. Do not do anything else until this all works happily.

Better check your v9 box too so we know what you are restoring.

/sbin/e-smith/audittools/newrpms
/sbin/e-smith/audittools/templates

Take down your v9 box and then restore the v10 so you do not get an IP clash.

Make sure there are no custom templates anywhere.

Reconfigure/reboot and test etc.

I have done most of these thing but is unable to take it up again until I get back on location in a couple of days. I have made a clean SME10 installation and it works fine. The problem comes after the USB disk restore. As far as I know I can only do this in the end of the installation.

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #29 on: July 26, 2021, 03:33:54 PM »
I have made a clean SME10 installation and it works fine. The problem comes after the USB disk restore. As far as I know I can only do this in the end of the installation.

You can do a restore from the console after the sme10 is fully installed and operational, reconfig/reboot required after restore, beware of custom templates, ip etc will be reset as per sme9 settings
--
qui scribit bis legit

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #30 on: July 27, 2021, 09:12:54 AM »
Quote
I have made a clean SME10 installation and it works fine. The problem comes after the USB disk restore.

So you have to do the restore and then work out why it doesn't work at that point without starting to hack stuff about.

Watch the logs as you restore. Check them all after reboot. What do the various dns logs say?

Quote
Also the old SME9 server is quite standard

'Quite'.

As I said above please post the audittools output so we can see what your v9 has.

Quote
I have not any settings in the Linksys router that will disallow dns traffic to the SME10. Only simple NAT forward settings to the SME9 server. It also work if I do the admin server console hack so in my view it can not be the router that is to blame

Something is blocking it. We haven't worked out what yet. So best look at facts, not opinions and guesses.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #31 on: July 31, 2021, 12:00:38 AM »
My apoligies, went to quote beast and inadvertently deleted the post, FML..here it is

Quote from: TerryF on July 27, 2021, 01:33:54 AM
You can do a restore from the console after the sme10 is fully installed and operational, reconfig/reboot required after restore, beware of custom templates, ip etc will be reset as per sme9 settings end quote

I tried this with the same result that DNS is not working. E.g. did a SME10 install, yum upgrade and testing everything and later I made the restore - same end result.

Now I will try with a different backup - just to make sure this is not the problem
« Last Edit: July 31, 2021, 12:06:27 AM by TerryF »
--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #32 on: July 31, 2021, 12:03:22 AM »
I tried this with the same result that DNS is not working. E.g. did a SME10 install, yum upgrade and testing everything and later I made the restore - same end result.

This is what I was trying to ask..

After the install and yum update you had connectivity, system is working as expected, after the restore it is lost.

Sorry again for my ham fingered keyboard skills..
« Last Edit: July 31, 2021, 02:38:27 AM by TerryF »
--
qui scribit bis legit

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #33 on: July 31, 2021, 04:19:03 PM »
This is what I was trying to ask..

After the install and yum update you had connectivity, system is working as expected, after the restore it is lost.

Sorry again for my ham fingered keyboard skills..

Yes :-)

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #34 on: July 31, 2021, 04:23:50 PM »
Like to add that when I have a working system after restore the system is still working right after the "signal-event post-upgrade". It is not working after the "signal-event reboot" have completed

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #35 on: July 31, 2021, 04:55:08 PM »
I have made some tar archives of the log folder during the process.

I made some notes about when in the process I made the archive but is unable to find it now :D

As far as I remember log2 is when the system is not working

https://drive.google.com/drive/folders/1Seg8N-df2-MB6fkAbWEQfjA9hTrZfG_h?usp=sharing

I will have to repeat the process when it is working and when it is not and make a archive again

I have tried to remove all custom templates to begin with.

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #36 on: July 31, 2021, 05:09:35 PM »
Have now made 2 more files at the same location.

https://drive.google.com/drive/folders/1Seg8N-df2-MB6fkAbWEQfjA9hTrZfG_h?usp=sharing

log_working.tar (start condition after the dns hack in admin server console)
log_notworking.tar (after a "signal-event post-upgrade; signal-event reboot")

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #37 on: July 31, 2021, 10:11:41 PM »
Thansk mate, logs essential in trying to find the why..time for some reading

At least its definitive that it is something being restored from the sme9 setup that is creating the issue the sme10.

Guarantee it will be something small,.straws, we all clutch at straws when situations like this arise.

Above you detailed -
Quote
I have not any settings in the Linksys router that will disallow dns traffic to the SME10. Only simple NAT forward settings to the SME9 server. It also work if I do the admin server console hack so in my view it can not be the router that is to blame.

Have you tried setup of NAT forwarding for the IP to the new sme10? Like I said just straws..

We'll get there, just a matter of finding the right rabbit hole :-)
--
qui scribit bis legit

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #38 on: August 05, 2021, 03:35:37 PM »
Have now tried with a new backup on a new HDD. It has to be < 2 Tb or it does not work. But the result is the same :-(

I was thinking about doing this upgrade in a different way with PHP and rsync:

Code: [Select]
$returnstr = shell_exec("signal-event pre-backup");

$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /home/e-smith/* root@x.x.x.x::beastserver/home/e-smith/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/e-smith/templates-custom/* root@x.x.x.x::beastserver/etc/e-smith/templates-custom/ --ignore-missing-args");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/e-smith/templates-user-custom/* root@x.x.x.x::beastserver/etc/e-smith/templates-user-custom/ --ignore-missing-args");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/ssh/* root@x.x.x.x::beastserver/etc/ssh/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /root/* root@x.x.x.x::beastserver/root/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/sudoers root@x.x.x.x::beastserver/etc/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/passwd root@x.x.x.x::beastserver/etc/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/shadow root@x.x.x.x::beastserver/etc/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/group root@x.x.x.x::beastserver/etc/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/gshadow root@x.x.x.x::beastserver/etc/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/dehydrated root@x.x.x.x::beastserver/etc/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/samba/secrets.tdb root@x.x.x.x::beastserver/etc/samba/");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/samba/smbpasswd root@x.x.x.x::beastserver/etc/samba/");

$returnstr .= shell_exec("signal-event post-backup");

Destination is a USB disk and this will make it more easy for me to find out where the problem is located as I may be able to upgrade different parts of the system. But I do not know the parts I have to replace at the same time to have a working system?


Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #39 on: August 05, 2021, 04:52:05 PM »
I think I said this to you earlier.

Quote
Make sure there are no custom templates anywhere.

So why have you got this?

Code: [Select]
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/e-smith/templates-custom/* root@x.x.x.x::beastserver/etc/e-smith/templates-custom/ --ignore-missing-args");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/e-smith/templates-user-custom/* root@x.x.x.x::beastserver/etc/e-smith/templates-user-custom/ --ignore-missing-args");


Next, I can see an issue in your logs but can't remember the solution - I think it is to do with missing information in ldap.

e.g.

Quote
Jul 31 16:24:55 beastserver2 esmith::event[4127]: You are about to be asked to enter information that will be incorporated
Jul 31 16:24:55 beastserver2 esmith::event[4127]: into your certificate request.
Jul 31 16:24:55 beastserver2 esmith::event[4127]: What you are about to enter is what is called a Distinguished Name or a DN.
Jul 31 16:24:55 beastserver2 esmith::event[4127]: There are quite a few fields but you can leave some blank
Jul 31 16:24:55 beastserver2 esmith::event[4127]: For some fields there will be a default value,
Jul 31 16:24:55 beastserver2 esmith::event[4127]: If you enter '.', the field will be left blank.
Jul 31 16:24:55 beastserver2 esmith::event[4127]: -----
Jul 31 16:24:55 beastserver2 esmith::event[4127]: Country Name (2 letter code) [XX]:State or Province Name (full name) []:Locality Name (eg, city) [Default City]:Organization Name (eg, company) [Default Company Ltd]:Organizational Unit Name (eg, section) []:Common Name (eg, your name or your server's hostname) []:Email Address []:expanding /var/service/sqpsmtpd/runenv


Please show:

Code: [Select]
config show ldap
Also I can see you are running owncloud..... and you have some issues in there eg

Quote
Jul 30 08:05:53 test console_restore: tar: home/e-smith/files/ibays/owncloud/html/data/......lnk: implausibly old time stamp 1970-01-01 01:00:00

You ought to go and fix some of the files - see your logs for which ones.

We also did ask you to try and get the output from newrpms and templates. This is why - so we know what else you have squirrelled away there that might be causing issues.

Ahhh, and then this....

Quote
Jul 30 14:29:34 test esmith::event[2651]: 
Jul 30 14:29:34 test esmith::event[2651]: Your ENVIRONMENT IS INSANE! Users in files "/etc/passwd" and "/etc/shadow are diffrent!!!
Jul 30 14:29:34 test esmith::event[2651]: I'll continue, but it is YOUR RISK! You'll probably go into BIG troubles!
Jul 30 14:29:34 test esmith::event[2651]: 
Jul 30 14:29:34 test esmith::event[2651]:  at /usr/share/perl5/vendor_perl/esmith/Backup.pm line 374.
Jul 30 14:29:34 test esmith::event[2651]: 
Jul 30 14:29:39 test esmith::event[2651]: 
Jul 30 14:29:39 test esmith::event[2651]: Your ENVIRONMENT IS INSANE! Users in files "/etc/passwd" and "/etc/shadow are diffrent!!!
Jul 30 14:29:39 test esmith::event[2651]: I'll continue, but it is YOUR RISK! You'll probably go into BIG troubles!
Jul 30 14:29:39 test esmith::event[2651]: 
Jul 30 14:29:39 test esmith::event[2651]:  at /usr/share/perl5/vendor_perl/esmith/Backup.pm line 382.
Jul 30 14:29:39 test esmith::event[2651]: 


And then this (a small section as there is a lot more)

Quote
Jul 30 14:29:54 test esmith::event[2651]: S10update-grub=action|Event|post-upgrade|Action|S10update-grub|Start|1627648190 503844|End|1627648194 380767|Elapsed|3.876923
Jul 30 14:29:54 test esmith::event[2651]: Running event handler: /etc/e-smith/events/post-upgrade/S15group-modify-unix
Jul 30 14:29:54 test esmith::event[2651]: usermod: no changes
Jul 30 14:29:54 test esmith::event[2651]: CPU: ldapUserMod: ldap_modify_s: No such object
Jul 30 14:29:54 test esmith::event[2651]:      The user 'all_group' specified could not be found in the directory.
Jul 30 14:29:54 test esmith::event[2651]:      Make sure the user is valid and the correct base for the user has been
Jul 30 14:29:54 test esmith::event[2651]:      specified.
Jul 30 14:29:54 test esmith::event[2651]: Failed to modify (ldap) group description for all_group.
Jul 30 14:29:54 test esmith::event[2651]: CPU: ldapGroupMod: ldap_modify_s: No such object
Jul 30 14:29:54 test esmith::event[2651]:      The group 'all_group' specified could not be found in the directory.
Jul 30 14:29:54 test esmith::event[2651]:      Make sure the group is valid and the correct base for the group has been
Jul 30 14:29:54 test esmith::event[2651]:      specified.
Jul 30 14:29:54 test esmith::event[2651]: Failed to modify (ldap) group description/email for all_group.

And then after you reboot you seem to have major borkage:

Quote
Jul 31 13:35:27 beastserver2 esmith::event[7142]: Running event handler: /etc/e-smith/events/post-upgrade/S15group-modify-unix
Jul 31 13:35:27 beastserver2 esmith::event[7142]: usermod: Ingen Test
Jul 31 13:37:34 beastserver2 esmith::event[7142]: CPU: ldapOperation: ldap_bind_s: Can't contact LDAP server
Jul 31 13:37:34 beastserver2 esmith::event[7142]:      The LDAP server specified at localhost could not be contacted.
Jul 31 13:37:34 beastserver2 esmith::event[7142]:      Your LDAP server may be down or incorrectly specified.
Jul 31 13:37:34 beastserver2 esmith::event[7142]: Failed to modify (ldap) group description for all_group.
Jul 31 13:39:41 beastserver2 esmith::event[7142]: CPU: ldapOperation: ldap_bind_s: Can't contact LDAP server
Jul 31 13:39:41 beastserver2 esmith::event[7142]:      The LDAP server specified at localhost could not be contacted.
Jul 31 13:39:41 beastserver2 esmith::event[7142]:      Your LDAP server may be down or incorrectly specified.
Jul 31 13:39:41 beastserver2 esmith::event[7142]: Failed to modify (ldap) group description/email for all_group.

Looks like your v9 server/backup is not well. What have you been up to?

On your v9 server please show:

Code: [Select]
rpm -qa |grep samba
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #40 on: August 05, 2021, 05:35:03 PM »
I think I said this to you earlier.

So why have you got this?

Code: [Select]
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/e-smith/templates-custom/* root@x.x.x.x::beastserver/etc/e-smith/templates-custom/ --ignore-missing-args");
$returnstr .= shell_exec("rsync -az -e \"ssh -p 22\" /etc/e-smith/templates-user-custom/* root@x.x.x.x::beastserver/etc/e-smith/templates-user-custom/ --ignore-missing-args");

I have deleted all files in those folders.
I am only planning to transfer those files to the new server to find a possible error.

Next, I can see an issue in your logs but can't remember the solution - I think it is to do with missing information in ldap.

e.g.

Please show:

Code: [Select]
config show ldap

[root@beastserver2 ~]# config show ldap
ldap=service
    Authentication=disabled
    Bootstrap=run
    TCPPort=389
    TCPPorts=389,636
    access=private
    defaultCity=[deleted]
    defaultCompany=Privat
    defaultDepartment=Main
    defaultPhoneNumber=+45 [deleted]
    defaultStreet=[deleted]
    status=enabled

Also I can see you are running owncloud..... and you have some issues in there eg

You ought to go and fix some of the files - see your logs for which ones.

Owncloud is messed up and not working anymore after an upgrade - not important for me

We also did ask you to try and get the output from newrpms and templates. This is why - so we know what else you have squirrelled away there that might be causing issues.

I do not understand what to do here?


Ahhh, and then this....

And then this (a small section as there is a lot more)

And then after you reboot you seem to have major borkage:

Looks like your v9 server/backup is not well. What have you been up to?

On your v9 server please show:

Code: [Select]
rpm -qa |grep samba

[root@beastserver ~]# rpm -qa |grep samba
samba-winbind-clients-3.6.23-53.el6_10.x86_64
e-smith-samba-2.4.0-27.el6.sme.noarch
samba-client-3.6.23-53.el6_10.x86_64
samba-common-3.6.23-53.el6_10.x86_64
samba-3.6.23-53.el6_10.x86_64
samba-winbind-3.6.23-53.el6_10.x86_64
« Last Edit: August 05, 2021, 05:36:51 PM by beast »

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #41 on: August 06, 2021, 01:21:56 AM »
apoligies beast, downloaded all the logs and got sidetracked..just back to it..

I think you may be better off doing a straight sme10 install, copy over users and their data, mysql, wiki has how to, and then install any contribs..

Might be quickest way to get a working system
--
qui scribit bis legit

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #42 on: August 06, 2021, 06:05:35 AM »
apoligies beast, downloaded all the logs and got sidetracked..just back to it..

I think you may be better off doing a straight sme10 install, copy over users and their data, mysql, wiki has how to, and then install any contribs..

Might be quickest way to get a working system

Yes - agree. Just trying to find out what is wrong to help other.

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #43 on: August 06, 2021, 09:34:11 AM »
Yes - agree. Just trying to find out what is wrong to help other.

Oh yeah, definetly, if nothing else makes for a better nights sleep :-)
--
qui scribit bis legit

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #44 on: August 06, 2021, 10:09:23 AM »
I think you may be better off doing a straight sme10 install, copy over users and their data, mysql, wiki has how to, and then install any contribs.

With the corruption in there I'm not sure how easy that is going to be with users.

Not sure how it has happened. I suspect either the famous samba from smedev, or possibly an issue with owncloud at somestage.

I would imagine there are some errors evident in the v9 logs too.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #45 on: August 06, 2021, 10:52:22 AM »
I think you may be better off doing a straight sme10 install, copy over users and their data, mysql, wiki has how to, and then install any contribs..

I am not sure about what wiki page you are referring to?

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #46 on: August 06, 2021, 11:38:06 AM »
Search for backup.

A bit like your script above.

https://wiki.koozali.org/Backup_server_config

However, you need to make sure your v9 is error free, and my guess is that it isn't. Something seems very odd with your password dbs and ldap db.

But we haven't seen anything from there so that's just a gut feeling.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #47 on: August 06, 2021, 11:41:21 AM »
Search for backup.

A bit like your script above.

https://wiki.koozali.org/Backup_server_config

However, you need to make sure your v9 is error free, and my guess is that it isn't. Something seems very odd with your password dbs and ldap db.

But we haven't seen anything from there so that's just a gut feeling.

Great thank you - That are more or less the procedure I was planning to follow.

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #48 on: August 06, 2021, 12:13:26 PM »
Great thank you - That are more or less the procedure I was planning to follow.

Be aware that as we have no idea about the damage in your v9 and you have not resolved that, the chances of this working correctly are low. I expect you will hit exactly the same issues as before because you have not resolved the underlying problems.

Yes, data and emails aren't difficult to move across - just a bit time consuming.

But you may have to recreate your users and groups again.

Still interested to know what you did to your v9 server.....
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #49 on: August 06, 2021, 12:46:08 PM »
Still interested to know what you did to your v9 server.....

I have no idea what I might have done.

Shall I make a copy of the logs from the old server or something else?

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #50 on: August 06, 2021, 02:34:45 PM »
I have no idea what I might have done.

Shall I make a copy of the logs from the old server or something else?

Cant hurt..all info is good info
--
qui scribit bis legit

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #51 on: August 06, 2021, 03:47:09 PM »
copy of db config with passwords removed and templates-custom folders could be of help. 


on the mean time you were asked few times to give us the output of two commands


/sbin/e-smith/audittools/newrpms
/sbin/e-smith/audittools/templates


Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #52 on: August 07, 2021, 08:57:27 AM »
/sbin/e-smith/audittools/newrpms
/sbin/e-smith/audittools/templates

"templates" does not generate any output.
"newrpms" generate the output below:
Code: [Select]
Indlæste udvidelsesmoduler: fastestmirror, post-transaction-actions, priorities,
                          : smeserver
Loading mirror speeds from cached hostfile
 * base: mirror.imt-systems.com
 * smeaddons: mirror.pialasse.com
 * smeos: mirror.pialasse.com
 * smeupdates: mirror.pialasse.com
 * updates: mirror.imt-systems.com
Ekstra pakker
GeoIP.x86_64                           1.6.12-9.el7.sme             @smecontribs
GeoIP-GeoLite-data.noarch              2018.06-7.el7.sme            @smecontribs
GeoIP-GeoLite-data-extra.noarch        2018.06-7.el7.sme            @smecontribs
php55-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php56-php.x86_64                       5.6.40-28.el7.remi           @remi-safe 
php56-php-bcmath.x86_64                5.6.40-28.el7.remi           @remi-safe 
php56-php-cli.x86_64                   5.6.40-28.el7.remi           @remi-safe 
php56-php-common.x86_64                5.6.40-28.el7.remi           @remi-safe 
php56-php-enchant.x86_64               5.6.40-28.el7.remi           @remi-safe 
php56-php-fpm.x86_64                   5.6.40-28.el7.remi           @remi-safe 
php56-php-gd.x86_64                    5.6.40-28.el7.remi           @remi-safe 
php56-php-imap.x86_64                  5.6.40-28.el7.remi           @remi-safe 
php56-php-intl.x86_64                  5.6.40-28.el7.remi           @remi-safe 
php56-php-ldap.x86_64                  5.6.40-28.el7.remi           @remi-safe 
php56-php-mbstring.x86_64              5.6.40-28.el7.remi           @remi-safe 
php56-php-mcrypt.x86_64                5.6.40-28.el7.remi           @remi-safe 
php56-php-mysqlnd.x86_64               5.6.40-28.el7.remi           @remi-safe 
php56-php-opcache.x86_64               5.6.40-28.el7.remi           @remi-safe 
php56-php-pdo.x86_64                   5.6.40-28.el7.remi           @remi-safe 
php56-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php56-php-process.x86_64               5.6.40-28.el7.remi           @remi-safe 
php56-php-snmp.x86_64                  5.6.40-28.el7.remi           @remi-safe 
php56-php-soap.x86_64                  5.6.40-28.el7.remi           @remi-safe 
php56-php-tidy.x86_64                  5.6.40-28.el7.remi           @remi-safe 
php56-php-xml.x86_64                   5.6.40-28.el7.remi           @remi-safe 
php56-php-xmlrpc.x86_64                5.6.40-28.el7.remi           @remi-safe 
php70-php.x86_64                       7.0.33-28.el7.remi           @remi-safe 
php70-php-bcmath.x86_64                7.0.33-28.el7.remi           @remi-safe 
php70-php-cli.x86_64                   7.0.33-28.el7.remi           @remi-safe 
php70-php-common.x86_64                7.0.33-28.el7.remi           @remi-safe 
php70-php-enchant.x86_64               7.0.33-28.el7.remi           @remi-safe 
php70-php-fpm.x86_64                   7.0.33-28.el7.remi           @remi-safe 
php70-php-gd.x86_64                    7.0.33-28.el7.remi           @remi-safe 
php70-php-imap.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-intl.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-json.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-ldap.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-mbstring.x86_64              7.0.33-28.el7.remi           @remi-safe 
php70-php-mcrypt.x86_64                7.0.33-28.el7.remi           @remi-safe 
php70-php-mysqlnd.x86_64               7.0.33-28.el7.remi           @remi-safe 
php70-php-opcache.x86_64               7.0.33-28.el7.remi           @remi-safe 
php70-php-pdo.x86_64                   7.0.33-28.el7.remi           @remi-safe 
php70-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php70-php-process.x86_64               7.0.33-28.el7.remi           @remi-safe 
php70-php-snmp.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-soap.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-tidy.x86_64                  7.0.33-28.el7.remi           @remi-safe 
php70-php-xml.x86_64                   7.0.33-28.el7.remi           @remi-safe 
php70-php-xmlrpc.x86_64                7.0.33-28.el7.remi           @remi-safe 
php71-php.x86_64                       7.1.33-15.el7.remi           @remi-safe 
php71-php-bcmath.x86_64                7.1.33-15.el7.remi           @remi-safe 
php71-php-cli.x86_64                   7.1.33-15.el7.remi           @remi-safe 
php71-php-common.x86_64                7.1.33-15.el7.remi           @remi-safe 
php71-php-enchant.x86_64               7.1.33-15.el7.remi           @remi-safe 
php71-php-fpm.x86_64                   7.1.33-15.el7.remi           @remi-safe 
php71-php-gd.x86_64                    7.1.33-15.el7.remi           @remi-safe 
php71-php-imap.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-intl.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-json.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-ldap.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-mbstring.x86_64              7.1.33-15.el7.remi           @remi-safe 
php71-php-mcrypt.x86_64                7.1.33-15.el7.remi           @remi-safe 
php71-php-mysqlnd.x86_64               7.1.33-15.el7.remi           @remi-safe 
php71-php-opcache.x86_64               7.1.33-15.el7.remi           @remi-safe 
php71-php-pdo.x86_64                   7.1.33-15.el7.remi           @remi-safe 
php71-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php71-php-process.x86_64               7.1.33-15.el7.remi           @remi-safe 
php71-php-snmp.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-soap.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-tidy.x86_64                  7.1.33-15.el7.remi           @remi-safe 
php71-php-xml.x86_64                   7.1.33-15.el7.remi           @remi-safe 
php71-php-xmlrpc.x86_64                7.1.33-15.el7.remi           @remi-safe 
php72-php.x86_64                       7.2.34-6.el7.remi            @remi-safe 
php72-php-bcmath.x86_64                7.2.34-6.el7.remi            @remi-safe 
php72-php-cli.x86_64                   7.2.34-6.el7.remi            @remi-safe 
php72-php-common.x86_64                7.2.34-6.el7.remi            @remi-safe 
php72-php-enchant.x86_64               7.2.34-6.el7.remi            @remi-safe 
php72-php-fpm.x86_64                   7.2.34-6.el7.remi            @remi-safe 
php72-php-gd.x86_64                    7.2.34-6.el7.remi            @remi-safe 
php72-php-imap.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-intl.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-json.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-ldap.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-mbstring.x86_64              7.2.34-6.el7.remi            @remi-safe 
php72-php-mysqlnd.x86_64               7.2.34-6.el7.remi            @remi-safe 
php72-php-opcache.x86_64               7.2.34-6.el7.remi            @remi-safe 
php72-php-pdo.x86_64                   7.2.34-6.el7.remi            @remi-safe 
php72-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php72-php-process.x86_64               7.2.34-6.el7.remi            @remi-safe 
php72-php-snmp.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-soap.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-tidy.x86_64                  7.2.34-6.el7.remi            @remi-safe 
php72-php-xml.x86_64                   7.2.34-6.el7.remi            @remi-safe 
php72-php-xmlrpc.x86_64                7.2.34-6.el7.remi            @remi-safe 
php73-php.x86_64                       7.3.29-1.el7.remi            @remi-safe 
php73-php-bcmath.x86_64                7.3.29-1.el7.remi            @remi-safe 
php73-php-cli.x86_64                   7.3.29-1.el7.remi            @remi-safe 
php73-php-common.x86_64                7.3.29-1.el7.remi            @remi-safe 
php73-php-enchant.x86_64               7.3.29-1.el7.remi            @remi-safe 
php73-php-fpm.x86_64                   7.3.29-1.el7.remi            @remi-safe 
php73-php-gd.x86_64                    7.3.29-1.el7.remi            @remi-safe 
php73-php-imap.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-intl.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-json.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-ldap.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-mbstring.x86_64              7.3.29-1.el7.remi            @remi-safe 
php73-php-mysqlnd.x86_64               7.3.29-1.el7.remi            @remi-safe 
php73-php-opcache.x86_64               7.3.29-1.el7.remi            @remi-safe 
php73-php-pdo.x86_64                   7.3.29-1.el7.remi            @remi-safe 
php73-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php73-php-process.x86_64               7.3.29-1.el7.remi            @remi-safe 
php73-php-snmp.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-soap.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-tidy.x86_64                  7.3.29-1.el7.remi            @remi-safe 
php73-php-xml.x86_64                   7.3.29-1.el7.remi            @remi-safe 
php73-php-xmlrpc.x86_64                7.3.29-1.el7.remi            @remi-safe 
php74-php.x86_64                       7.4.22-1.el7.remi            @remi-safe 
php74-php-bcmath.x86_64                7.4.22-1.el7.remi            @remi-safe 
php74-php-cli.x86_64                   7.4.22-1.el7.remi            @remi-safe 
php74-php-common.x86_64                7.4.22-1.el7.remi            @remi-safe 
php74-php-enchant.x86_64               7.4.22-1.el7.remi            @remi-safe 
php74-php-fpm.x86_64                   7.4.22-1.el7.remi            @remi-safe 
php74-php-gd.x86_64                    7.4.22-1.el7.remi            @remi-safe 
php74-php-imap.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-intl.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-json.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-ldap.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-mbstring.x86_64              7.4.22-1.el7.remi            @remi-safe 
php74-php-mysqlnd.x86_64               7.4.22-1.el7.remi            @remi-safe 
php74-php-opcache.x86_64               7.4.22-1.el7.remi            @remi-safe 
php74-php-pdo.x86_64                   7.4.22-1.el7.remi            @remi-safe 
php74-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php74-php-process.x86_64               7.4.22-1.el7.remi            @remi-safe 
php74-php-snmp.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-soap.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-sodium.x86_64                7.4.22-1.el7.remi            @remi-safe 
php74-php-tidy.x86_64                  7.4.22-1.el7.remi            @remi-safe 
php74-php-xml.x86_64                   7.4.22-1.el7.remi            @remi-safe 
php74-php-xmlrpc.x86_64                7.4.22-1.el7.remi            @remi-safe 
php80-php.x86_64                       8.0.9-1.el7.remi             @remi-safe 
php80-php-bcmath.x86_64                8.0.9-1.el7.remi             @remi-safe 
php80-php-cli.x86_64                   8.0.9-1.el7.remi             @remi-safe 
php80-php-common.x86_64                8.0.9-1.el7.remi             @remi-safe 
php80-php-enchant.x86_64               8.0.9-1.el7.remi             @remi-safe 
php80-php-fpm.x86_64                   8.0.9-1.el7.remi             @remi-safe 
php80-php-gd.x86_64                    8.0.9-1.el7.remi             @remi-safe 
php80-php-imap.x86_64                  8.0.9-1.el7.remi             @remi-safe 
php80-php-intl.x86_64                  8.0.9-1.el7.remi             @remi-safe 
php80-php-ldap.x86_64                  8.0.9-1.el7.remi             @remi-safe 
php80-php-mbstring.x86_64              8.0.9-1.el7.remi             @remi-safe 
php80-php-mysqlnd.x86_64               8.0.9-1.el7.remi             @remi-safe 
php80-php-opcache.x86_64               8.0.9-1.el7.remi             @remi-safe 
php80-php-pdo.x86_64                   8.0.9-1.el7.remi             @remi-safe 
php80-php-pear.noarch                  1:1.10.12-9.el7.remi         @remi-safe 
php80-php-process.x86_64               8.0.9-1.el7.remi             @remi-safe 
php80-php-snmp.x86_64                  8.0.9-1.el7.remi             @remi-safe 
php80-php-soap.x86_64                  8.0.9-1.el7.remi             @remi-safe 
php80-php-sodium.x86_64                8.0.9-1.el7.remi             @remi-safe 
php80-php-tidy.x86_64                  8.0.9-1.el7.remi             @remi-safe 
php80-php-xml.x86_64                   8.0.9-1.el7.remi             @remi-safe 




Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #53 on: August 07, 2021, 09:06:29 AM »
Have been messing a bit around with the system and have the following observations that might help.

When the server is in the condition where it is unable to use dns it is not possible to run a "signal-event post-upgrade" as it never returns and I have to terminate it. If I login to the server console right after this I am also unable to configure server in the server console as it return to the main screen right away when selected (do not know if this is because I have terminated the post-upgrade). I have to reboot before I can configure the server. When I then have made the dns hack (first select 1.1.1.1, reconfigure and then clear dns string and reconfigure) I do not have a working internet connection right away in the server console as the first attempt is unsuccessful and it only succeed at the second attempt (no matter how long I wait for the first attempt)
« Last Edit: August 07, 2021, 09:08:14 AM by beast »

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #54 on: August 07, 2021, 09:29:05 AM »
After some more test I must conclude that a simple reboot also break the dns. E.g. no need to do a "signal-event post-upgrade".

I did not see this before as it is not that often I need to reboot the server ;-)

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #55 on: August 07, 2021, 11:44:06 AM »
I dont know what you have in the way of hardware etc, but I would be curious to see the outcome of restoring your backup to a clean sme9, is that instance working OK, backup that and use that backup see what happens, a long winding way to do it but just curious to see what happens, time and resources is the factor...

Notice I say "I would" :-) I have time and resources..
--
qui scribit bis legit

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #56 on: August 07, 2021, 11:52:06 AM »
I dont know what you have in the way of hardware etc, but I would be curious to see the outcome of restoring your backup to a clean sme9, is that instance working OK, backup that and use that backup see what happens, a long winding way to do it but just curious to see what happens, time and resources is the factor...

Notice I say "I would" :-) I have time and resources..

No problem - will do it and return. Just garden work anyway ;-)

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #57 on: August 07, 2021, 12:05:09 PM »
After some more test I must conclude that a simple reboot also break the dns. E.g. no need to do a "signal-event post-upgrade".

I did not see this before as it is not that often I need to reboot the server ;-)

You are completely missing the point here.

Once you restore your settings are borked because something is wrong on v9, and hence your backup, which means the v10 system is unable to run the dns services correctly. Read my comments above, and read your logs.

Nothing will fix that.

You set a manual DNS which bodges it's way round the real issue which is borked users & dns services, but doesn't fix it.

Some solutions:

1. Fix your v9 before backup (still not seen logs from there)
2. Copy data manually and re-create users
3. Restore v9 from known good backup, then migrate

Note the templates & newrpms we want are from v9, not v10, so we can try and see how and what you broke on v9.

That is where the real issue lies. All the issues with v10 are due to broken data from v9.

We are unlikely to be able to fix your v10 currently.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #58 on: August 07, 2021, 12:09:30 PM »
I dont know what you have in the way of hardware etc, but I would be curious to see the outcome of restoring your backup to a clean sme9, is that instance working OK, backup that and use that backup see what happens, a long winding way to do it but just curious to see what happens, time and resources is the factor...

Notice I say "I would" :-) I have time and resources..

Both servers have identical HW except storage

Asus P8H61-MX USB3
Intel(R) Core(TM) i3-3220T CPU @ 2.80GHz
16 gB mem

The SME9 server have 2 TB HDD in raid 1
The SME10 server have 2 TB SSD (MX500) in raid 1


Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #59 on: August 07, 2021, 12:14:04 PM »
You are completely missing the point here.

Once you restore your settings are borked because something is wrong on v9, and hence your backup, which means the v10 system is unable to run the dns services correctly. Read my comments above, and read your logs.

Nothing will fix that.

You set a manual DNS which bodges it's way round the real issue which is borked users & dns services, but doesn't fix it.

Some solutions:

1. Fix your v9 before backup (still not seen logs from there)
2. Copy data manually and re-create users
3. Restore v9 from known good backup, then migrate

Note the templates & newrpms we want are from v9, not v10, so we can try and see how and what you broke on v9.

That is where the real issue lies. All the issues with v10 are due to broken data from v9.

We are unlikely to be able to fix your v10 currently.

Output from SME9

Code: [Select]
[root@beastserver ~]# /sbin/e-smith/audittools/newrpms
Indlæste udvidelsesmoduler: fastestmirror, post-transaction-actions, smeserver
Loading mirror speeds from cached hostfile
 * smeaddons: ibsgaarden.dk
 * smeos: ibsgaarden.dk
 * smeupdates: ibsgaarden.dk
Ekstra pakker
dehydrated.noarch                  0.6.5-1.el6                      @smecontribs
denyhosts.noarch                   2.6-20.el6                       @smecontribs
gd-last.x86_64                     2.3.0-2.el6.remi                 @remi-safe 
gitflow.noarch                     0.4.2.20120723git53e9c76-4.el6   @epel       
highlight.x86_64                   3.8-1.el6                        @epel       
libargon2.x86_64                   20161029-7.el6.remi              @remi-safe 
libicu-last.x86_64                 50.1.2-17.el6.remi               @remi-safe 
liblzf.x86_64                      3.6-2.el6                        @epel       
libmcrypt.x86_64                   2.5.8-9.el6                      @smecontribs
libwebp.x86_64                     0.4.3-3.el6                      @smecontribs
libzip5.x86_64                     1.7.3-1.el6.remi                 @remi-safe 
oniguruma5php.x86_64               6.9.6-1.el6.remi                 @remi-safe 
perl-Config-IniFiles.noarch        2.72-2.el6                       @smecontribs
perl-Data-Validate-IP.noarch       0.10-1.el6.rf                    @smecontribs
perl-IO-Socket-INET6.noarch        2.72-1.of.el6                    @smecontribs
perl-Net-Netmask.noarch            1.9015-8.el6                     @smecontribs
perl-Proc-ProcessTable.x86_64      0.48-1.el6                       @smecontribs
php-fedora-autoloader.noarch       1.0.1-2.el6                      @smecontribs
php-php-gettext.noarch             1.0.12-1.el6                     @smecontribs
php-tcpdf.noarch                   6.2.26-1.el6                     @smecontribs
php-tcpdf-dejavu-sans-fonts.noarch 6.2.26-1.el6                     @smecontribs
php54.x86_64                       2.1-4.el6.remi                   @remi-safe 
php54-php.x86_64                   5.4.45-18.el6.remi               @remi-safe 
php54-php-bcmath.x86_64            5.4.45-18.el6.remi               @remi-safe 
php54-php-cli.x86_64               5.4.45-18.el6.remi               @remi-safe 
php54-php-common.x86_64            5.4.45-18.el6.remi               @remi-safe 
php54-php-enchant.x86_64           5.4.45-18.el6.remi               @remi-safe 
php54-php-gd.x86_64                5.4.45-18.el6.remi               @remi-safe 
php54-php-imap.x86_64              5.4.45-18.el6.remi               @remi-safe 
php54-php-ldap.x86_64              5.4.45-18.el6.remi               @remi-safe 
php54-php-mbstring.x86_64          5.4.45-18.el6.remi               @remi-safe 
php54-php-mcrypt.x86_64            5.4.45-18.el6.remi               @remi-safe 
php54-php-mysqlnd.x86_64           5.4.45-18.el6.remi               @remi-safe 
php54-php-pdo.x86_64               5.4.45-18.el6.remi               @remi-safe 
php54-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php54-php-pecl-igbinary.x86_64     2.0.8-1.el6.remi                 @remi       
php54-php-pecl-redis.x86_64        3.1.6-1.el6.remi                 @remi       
php54-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php54-php-process.x86_64           5.4.45-18.el6.remi               @remi-safe 
php54-php-soap.x86_64              5.4.45-18.el6.remi               @remi-safe 
php54-php-tidy.x86_64              5.4.45-18.el6.remi               @remi-safe 
php54-php-xml.x86_64               5.4.45-18.el6.remi               @remi-safe 
php54-runtime.x86_64               2.1-4.el6.remi                   @remi-safe 
php55.x86_64                       2.1-5.el6.remi                   @remi-safe 
php55-php.x86_64                   5.5.38-12.el6.remi               @remi-safe 
php55-php-bcmath.x86_64            5.5.38-12.el6.remi               @remi-safe 
php55-php-cli.x86_64               5.5.38-12.el6.remi               @remi-safe 
php55-php-common.x86_64            5.5.38-12.el6.remi               @remi-safe 
php55-php-enchant.x86_64           5.5.38-12.el6.remi               @remi-safe 
php55-php-gd.x86_64                5.5.38-12.el6.remi               @remi-safe 
php55-php-imap.x86_64              5.5.38-12.el6.remi               @remi-safe 
php55-php-ldap.x86_64              5.5.38-12.el6.remi               @remi-safe 
php55-php-mbstring.x86_64          5.5.38-12.el6.remi               @remi-safe 
php55-php-mcrypt.x86_64            5.5.38-12.el6.remi               @remi-safe 
php55-php-mysqlnd.x86_64           5.5.38-12.el6.remi               @remi-safe 
php55-php-pdo.x86_64               5.5.38-12.el6.remi               @remi-safe 
php55-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php55-php-pecl-igbinary.x86_64     2.0.8-1.el6.remi                 @remi       
php55-php-pecl-jsonc.x86_64        1.3.10-1.el6.remi                @remi-safe 
php55-php-pecl-redis.x86_64        3.1.6-1.el6.remi                 @remi       
php55-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php55-php-process.x86_64           5.5.38-12.el6.remi               @remi-safe 
php55-php-soap.x86_64              5.5.38-12.el6.remi               @remi-safe 
php55-php-tidy.x86_64              5.5.38-12.el6.remi               @remi-safe 
php55-php-xml.x86_64               5.5.38-12.el6.remi               @remi-safe 
php55-runtime.x86_64               2.1-5.el6.remi                   @remi-safe 
php56.x86_64                       3.0-1.el6.remi                   @remi-safe 
php56-php.x86_64                   5.6.40-23.el6.remi               @remi-safe 
php56-php-bcmath.x86_64            5.6.40-23.el6.remi               @remi-safe 
php56-php-cli.x86_64               5.6.40-23.el6.remi               @remi-safe 
php56-php-common.x86_64            5.6.40-23.el6.remi               @remi-safe 
php56-php-enchant.x86_64           5.6.40-23.el6.remi               @remi-safe 
php56-php-gd.x86_64                5.6.40-23.el6.remi               @remi-safe 
php56-php-imap.x86_64              5.6.40-23.el6.remi               @remi-safe 
php56-php-ldap.x86_64              5.6.40-23.el6.remi               @remi-safe 
php56-php-mbstring.x86_64          5.6.40-23.el6.remi               @remi-safe 
php56-php-mcrypt.x86_64            5.6.40-23.el6.remi               @remi-safe 
php56-php-mysqlnd.x86_64           5.6.40-23.el6.remi               @remi-safe 
php56-php-pdo.x86_64               5.6.40-23.el6.remi               @remi-safe 
php56-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php56-php-pecl-igbinary.x86_64     2.0.8-1.el6.remi                 @remi       
php56-php-pecl-jsonc.x86_64        1.3.10-1.el6.remi                @remi-safe 
php56-php-pecl-redis.x86_64        3.1.6-1.el6.remi                 @remi       
php56-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php56-php-process.x86_64           5.6.40-23.el6.remi               @remi-safe 
php56-php-soap.x86_64              5.6.40-23.el6.remi               @remi-safe 
php56-php-tidy.x86_64              5.6.40-23.el6.remi               @remi-safe 
php56-php-xml.x86_64               5.6.40-23.el6.remi               @remi-safe 
php56-runtime.x86_64               3.0-1.el6.remi                   @remi-safe 
php70.x86_64                       2.0-1.el6.remi                   @remi-safe 
php70-php.x86_64                   7.0.33-23.el6.remi               @remi-safe 
php70-php-bcmath.x86_64            7.0.33-23.el6.remi               @remi-safe 
php70-php-cli.x86_64               7.0.33-23.el6.remi               @remi-safe 
php70-php-common.x86_64            7.0.33-23.el6.remi               @remi-safe 
php70-php-enchant.x86_64           7.0.33-23.el6.remi               @remi-safe 
php70-php-gd.x86_64                7.0.33-23.el6.remi               @remi-safe 
php70-php-imap.x86_64              7.0.33-23.el6.remi               @remi-safe 
php70-php-json.x86_64              7.0.33-23.el6.remi               @remi-safe 
php70-php-ldap.x86_64              7.0.33-23.el6.remi               @remi-safe 
php70-php-mbstring.x86_64          7.0.33-23.el6.remi               @remi-safe 
php70-php-mcrypt.x86_64            7.0.33-23.el6.remi               @remi-safe 
php70-php-mysqlnd.x86_64           7.0.33-23.el6.remi               @remi-safe 
php70-php-pdo.x86_64               7.0.33-23.el6.remi               @remi-safe 
php70-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php70-php-pecl-igbinary.x86_64     3.1.6-1.el6.remi                 @remi       
php70-php-pecl-mysql.x86_64        1.0.0-0.9.20151007git294ce3b.el6.remi
                                                                    @remi-safe 
php70-php-pecl-redis.x86_64        3.1.6-1.el6.remi                 @remi       
php70-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php70-php-process.x86_64           7.0.33-23.el6.remi               @remi-safe 
php70-php-soap.x86_64              7.0.33-23.el6.remi               @remi-safe 
php70-php-tidy.x86_64              7.0.33-23.el6.remi               @remi-safe 
php70-php-xml.x86_64               7.0.33-23.el6.remi               @remi-safe 
php70-runtime.x86_64               2.0-1.el6.remi                   @remi-safe 
php71.x86_64                       2.0-1.el6.remi                   @remi-safe 
php71-php.x86_64                   7.1.33-10.el6.remi               @remi-safe 
php71-php-bcmath.x86_64            7.1.33-10.el6.remi               @remi-safe 
php71-php-cli.x86_64               7.1.33-10.el6.remi               @remi-safe 
php71-php-common.x86_64            7.1.33-10.el6.remi               @remi-safe 
php71-php-enchant.x86_64           7.1.33-10.el6.remi               @remi-safe 
php71-php-gd.x86_64                7.1.33-10.el6.remi               @remi-safe 
php71-php-gmp.x86_64               7.1.33-10.el6.remi               @remi-safe 
php71-php-imap.x86_64              7.1.33-10.el6.remi               @remi-safe 
php71-php-intl.x86_64              7.1.33-10.el6.remi               @remi-safe 
php71-php-json.x86_64              7.1.33-10.el6.remi               @remi-safe 
php71-php-ldap.x86_64              7.1.33-10.el6.remi               @remi-safe 
php71-php-mbstring.x86_64          7.1.33-10.el6.remi               @remi-safe 
php71-php-mcrypt.x86_64            7.1.33-10.el6.remi               @remi-safe 
php71-php-mysqlnd.x86_64           7.1.33-10.el6.remi               @remi-safe 
php71-php-pdo.x86_64               7.1.33-10.el6.remi               @remi-safe 
php71-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php71-php-pecl-igbinary.x86_64     3.1.6-1.el6.remi                 @remi       
php71-php-pecl-mysql.x86_64        1.0.0-0.15.20160812git230a828.el6.remi
                                                                    @remi-safe 
php71-php-pecl-redis.x86_64        3.1.6-1.el6.remi                 @remi       
php71-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php71-php-process.x86_64           7.1.33-10.el6.remi               @remi-safe 
php71-php-soap.x86_64              7.1.33-10.el6.remi               @remi-safe 
php71-php-tidy.x86_64              7.1.33-10.el6.remi               @remi-safe 
php71-php-xml.x86_64               7.1.33-10.el6.remi               @remi-safe 
php71-runtime.x86_64               2.0-1.el6.remi                   @remi-safe 
php72.x86_64                       2.0-1.el6.remi                   @remi-safe 
php72-php.x86_64                   7.2.34-1.el6.remi                @remi-safe 
php72-php-bcmath.x86_64            7.2.34-1.el6.remi                @remi-safe 
php72-php-cli.x86_64               7.2.34-1.el6.remi                @remi-safe 
php72-php-common.x86_64            7.2.34-1.el6.remi                @remi-safe 
php72-php-enchant.x86_64           7.2.34-1.el6.remi                @remi-safe 
php72-php-gd.x86_64                7.2.34-1.el6.remi                @remi-safe 
php72-php-imap.x86_64              7.2.34-1.el6.remi                @remi-safe 
php72-php-intl.x86_64              7.2.34-1.el6.remi                @remi-safe 
php72-php-json.x86_64              7.2.34-1.el6.remi                @remi-safe 
php72-php-ldap.x86_64              7.2.34-1.el6.remi                @remi-safe 
php72-php-mbstring.x86_64          7.2.34-1.el6.remi                @remi-safe 
php72-php-mysqlnd.x86_64           7.2.34-1.el6.remi                @remi-safe 
php72-php-pdo.x86_64               7.2.34-1.el6.remi                @remi-safe 
php72-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php72-php-pecl-mcrypt.x86_64       1.0.3-1.el6.remi                 @remi-safe 
php72-php-pecl-mysql.x86_64        1.0.0-0.17.20160812git230a828.el6.remi
                                                                    @remi-safe 
php72-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php72-php-process.x86_64           7.2.34-1.el6.remi                @remi-safe 
php72-php-soap.x86_64              7.2.34-1.el6.remi                @remi-safe 
php72-php-tidy.x86_64              7.2.34-1.el6.remi                @remi-safe 
php72-php-xml.x86_64               7.2.34-1.el6.remi                @remi-safe 
php72-runtime.x86_64               2.0-1.el6.remi                   @remi-safe 
php73.x86_64                       2.0-1.el6.remi                   @remi-safe 
php73-php.x86_64                   7.3.25-1.el6.remi                @remi-safe 
php73-php-bcmath.x86_64            7.3.25-1.el6.remi                @remi-safe 
php73-php-cli.x86_64               7.3.25-1.el6.remi                @remi-safe 
php73-php-common.x86_64            7.3.25-1.el6.remi                @remi-safe 
php73-php-enchant.x86_64           7.3.25-1.el6.remi                @remi-safe 
php73-php-gd.x86_64                7.3.25-1.el6.remi                @remi-safe 
php73-php-imap.x86_64              7.3.25-1.el6.remi                @remi-safe 
php73-php-intl.x86_64              7.3.25-1.el6.remi                @remi-safe 
php73-php-json.x86_64              7.3.25-1.el6.remi                @remi-safe 
php73-php-ldap.x86_64              7.3.25-1.el6.remi                @remi-safe 
php73-php-mbstring.x86_64          7.3.25-1.el6.remi                @remi-safe 
php73-php-mysqlnd.x86_64           7.3.25-1.el6.remi                @remi-safe 
php73-php-pdo.x86_64               7.3.25-1.el6.remi                @remi-safe 
php73-php-pear.noarch              1:1.10.12-4.el6.remi             @remi-safe 
php73-php-pecl-apcu.x86_64         5.1.19-1.el6.remi                @remi       
php73-php-pecl-igbinary.x86_64     3.1.6-1.el6.remi                 @remi       
php73-php-pecl-mysql.x86_64        1.0.0-0.20.20180226.647c933.el6.remi
                                                                    @remi-safe 
php73-php-pecl-redis4.x86_64       4.3.0-1.el6.remi                 @remi       
php73-php-pecl-zip.x86_64          1.19.2-1.el6.remi                @remi-safe 
php73-php-process.x86_64           7.3.25-1.el6.remi                @remi-safe 
php73-php-soap.x86_64              7.3.25-1.el6.remi                @remi-safe 
php73-php-tidy.x86_64              7.3.25-1.el6.remi                @remi-safe 
php73-php-xml.x86_64               7.3.25-1.el6.remi                @remi-safe 
php73-runtime.x86_64               2.0-1.el6.remi                   @remi-safe 
phpMyAdmin.noarch                  4.0.10.20-1.el6                  @smecontribs
redis.x86_64                       6.0.9-2.el6.remi                 @remi       
shflags.noarch                     1.0.3-4.el6                      @epel       
smeserver-denyhosts.noarch         2.9-11.el6.sme                   @smecontribs
smeserver-git.noarch               1.2.0-2.el6.sme                  @smecontribs
smeserver-gitweb.noarch            1.1.0-12.el6.sme                 @smecontribs
smeserver-gitweb-theme.noarch      1.1.0-0.el6.sme                  @smecontribs
smeserver-letsencrypt.noarch       0.5-15                           @smecontribs
smeserver-mod_deflate.noarch       1.2-1.el6.sme                    @smecontribs
smeserver-php-scl.noarch           0.4-25.el6.sme                   @smecontribs
smeserver-phpmyadmin.noarch        4.0.10.2-3.el6.sme               @smecontribs
smeserver-remoteuseraccess.noarch  1.3-2.el6.sme                    @smecontribs
smeserver-wbl.noarch               0.3.0-19.el6.sme                 @smecontribs
sqlite.x86_64                      3.7.17-9.el6.sme                 @smecontribs

Code: [Select]
[root@beastserver ~]# /sbin/e-smith/audittools/templates
/etc/e-smith/templates-custom/home/e-smith/ssl.crt: MANUALLY_ADDED, OVERRIDE
/etc/e-smith/templates-custom/opt/remi/php71/root/etc/php.ini/80ModuleSettings03Debugger: MANUALLY_ADDED, OVERRIDE
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/VirtualHosts40ACME: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/20LoadModule80PHP: OWNED_BY_RPM, OVERRIDE
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/99allow_url_fopen: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/pcryptapacheheader: MANUALLY_ADDED, ADDITION
/etc/e-smith/templates-custom/etc/hosts.allow/sshd: OWNED_BY_RPM, OVERRIDE
[root@beastserver ~]#


Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #60 on: August 07, 2021, 12:39:39 PM »
You are completely missing the point here.

Once you restore your settings are borked because something is wrong on v9, and hence your backup, which means the v10 system is unable to run the dns services correctly. Read my comments above, and read your logs.

Nothing will fix that.

You set a manual DNS which bodges it's way round the real issue which is borked users & dns services, but doesn't fix it.

Some solutions:

1. Fix your v9 before backup (still not seen logs from there)
2. Copy data manually and re-create users
3. Restore v9 from known good backup, then migrate

Note the templates & newrpms we want are from v9, not v10, so we can try and see how and what you broke on v9.

That is where the real issue lies. All the issues with v10 are due to broken data from v9.

We are unlikely to be able to fix your v10 currently.

SME9 logs are here: https://drive.google.com/file/d/1dntyKV2X4zvqB2EPgeDPBee6HDxFT3fI/view?usp=sharing

Sorry if I misunderstand things. But then the instructions are not clear enough for me.

I still think it is a valid way to find out the problem on the SME10 and in this way get a hint about the root course. Also in this way possible to avoid the same problem for others. But also fine to follow this other way around and try to find errors on the old server.

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #61 on: August 07, 2021, 03:13:43 PM »
I still think it is a valid way to find out the problem on the SME10 and in this way get a hint about the root course. Also in this way possible to avoid the same problem for others. But also fine to follow this other way around and try to find errors on the old server.

i've already said the likely root cause, but again:

From your logs on v10 we can already see the damage is done by a bad backup from your v9 box. Broken dns is just a symptom of that damage. The restore does not appear to complete correctly and certain vital bits are broken.

This is likely due to something breaking during install on v9. Owncloud, which does not show in your list, but we know you installed, is a candidate. I suspect something else - samba/other ldap - we can't see and you have not mentioned as well.

You installed something, it broke, you uninstalled, and thought it was ok. But wasn't.

============

As a result you aren't going to be able to repair your broken v10 in a hurry.

I'll take a look at your v9 logs and see if there is anything obvious.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #62 on: August 07, 2021, 04:15:37 PM »
i've already said the likely root cause, but again:

From your logs on v10 we can already see the damage is done by a bad backup from your v9 box. Broken dns is just a symptom of that damage. The restore does not appear to complete correctly and certain vital bits are broken.

This is likely due to something breaking during install on v9. Owncloud, which does not show in your list, but we know you installed, is a candidate. I suspect something else - samba/other ldap - we can't see and you have not mentioned as well.

You installed something, it broke, you uninstalled, and thought it was ok. But wasn't.

============

As a result you aren't going to be able to repair your broken v10 in a hurry.

I'll take a look at your v9 logs and see if there is anything obvious.

This is what I have in my documentation that I have installed at some point (some are not installed):

Code: [Select]
Denyhost http://wiki.contribs.org/Denyhosts
Awstats http://wiki.contribs.org/AWStats
WBL https://wiki.contribs.org/Email_Whitelist-Blacklist_Control
Webhosting https://wiki.koozali.org/Webhosting
Phpmyadmin https://wiki.contribs.org/PHPMyAdmin
"ModDeflate
" https://wiki.koozali.org/Mod_Deflate
Owncloud http://wiki.contribs.org/OwnCloud
Smart monitor http://wiki.contribs.org/Monitor_Disk_Health
User manager http://wiki.contribs.org/UserManager
Højere versioner af programmer http://wiki.contribs.org/Software_collections
Højere PHP version http://wiki.contribs.org/PHP_Software_Collections
remoteuseraccess http://wiki.contribs.org/Remoteuseraccess
Rkhunter http://wiki.contribs.org/Rkhunter
Letsencrypt https://wiki.contribs.org/index.php?title=Letsencrypt
SRP https://wiki.contribs.org/Email#DKIM_Setup_-_qpsmtpd_version_.3E.3D_0.96
PHP intl (needed by owncloud) yum install php73-php-intl
PHP apcu (needed by owncloud) yum --enablerepo=remi install php73-php-pecl-apcu
Git https://wiki.contribs.org/Git
Git flow yum --enablerepo=epel install gitflow
DKIM + DMARC + SPF https://wiki.contribs.org/Email#DKIM_Setup_-_qpsmtpd_version_.3E.3D_0.96
UPS https://wiki.contribs.org/Uninterruptable_Power_Supply#tab=SME_9

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #63 on: August 07, 2021, 06:12:52 PM »
OK, I just had a look through your logs and what a tangled web you have woven.

The problem with logs is they can find you out. Where was this mentioned? Not anywhere in your lists.

Quote
beastserver yum[5367]: Erased: smeserver-affa

I'd like you to open these two logs and then tell us what you have really been up to, because it isn't anything like you have outlined here so far.

Code: [Select]
cat messages.20210711114349
cat messages.20210711114350

I'm pretty sure you have seen a mountain of errors already but are hoping that you can just resolve them on v10.

Your problems started long before you ever got to v10. You are not going to resolve them on v10 either.

My little guess.

You borked your v9, probably with owncloud but I think you might have had wordpress on there somewhere at some point? maybe that was the issue and you got hacked - so decided to restore it from an affa server. But unfortunately that backup was also borked.

So you decided that you would run a standard backup and then install that on v10 and then fix it from there.

That's my rough guess - might not be quite right, but not far away.

Sorry to sound a bit cynical but you could have saved us 5 pages of running around and comments if you had told us the whole situation from the start.

My suggestion is you create a new v10, re-create all your users and groups, take your basic data and email directories and copy them to the new server, and update the file usernames and groups accordingly.

...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #64 on: August 07, 2021, 11:28:28 PM »
install fresh sme10
use lazy admin tool to migrate users /domains /host. 

not sure shadow migration will work as your shadow passwrd files are borked.  you might need to redefine password for your users.

would suggest not to migrate config db and network db.

then copy using rsync your ibays/users data. 

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #65 on: August 08, 2021, 08:17:41 AM »
OK, I just had a look through your logs and what a tangled web you have woven.

The problem with logs is they can find you out. Where was this mentioned? Not anywhere in your lists.

I'd like you to open these two logs and then tell us what you have really been up to, because it isn't anything like you have outlined here so far.

Code: [Select]
cat messages.20210711114349
cat messages.20210711114350

I'm pretty sure you have seen a mountain of errors already but are hoping that you can just resolve them on v10.

Your problems started long before you ever got to v10. You are not going to resolve them on v10 either.

My little guess.

You borked your v9, probably with owncloud but I think you might have had wordpress on there somewhere at some point? maybe that was the issue and you got hacked - so decided to restore it from an affa server. But unfortunately that backup was also borked.

So you decided that you would run a standard backup and then install that on v10 and then fix it from there.

That's my rough guess - might not be quite right, but not far away.

Sorry to sound a bit cynical but you could have saved us 5 pages of running around and comments if you had told us the whole situation from the start.

My suggestion is you create a new v10, re-create all your users and groups, take your basic data and email directories and copy them to the new server, and update the file usernames and groups accordingly.

I'm a little in shock here. Out of the blue, you accuse me of a hidden agenda to entice others to help me. In the best faith, I have reported on my problems. I have a perfectly working SME9 server as far as I know. With the time I have spent on this issue, I might as well have moved it all manually to another Linux distribution. The only problem I have had is that the server has become too hot a few times due to faulty ventilation which has caused it to be necessary to replace hard drives. This together with the missing updates on SME9 made me decide to try and upgrade and use SSDs on the new system.

The reason I have "Erased: smeserver-affa" is because I in the past have used Affa to move to new hardware when I upgrade to a new version as I have 2 identical servers to have as little down time as possible.

The 2 requested files are here:
https://drive.google.com/file/d/1cr8b3KmmomxwPh85s8XbctY4lytMredI/view?usp=sharing
https://drive.google.com/file/d/1V3XArH8PeV-BW8Mj74awqDcsvw45_zp3/view?usp=sharing
« Last Edit: August 08, 2021, 08:35:13 AM by beast »

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #66 on: August 08, 2021, 11:52:36 AM »
Quote
I'm a little in shock here. Out of the blue, you accuse me of a hidden agenda to entice others to help me. In the best faith, I have reported on my problems. I have a perfectly working SME9 server as far as I know.

I'm just trying to discover what happened so we can try to fix an issue.

I've just said you haven't told us the whole story, which is true.

Because of that we've wasted a lot of time we could have spent on other things.

This is a classic:

https://xyproblem.info/

If we had known all this at the start (and the reason I asked several times for more info including my gist on giving proper information) we could have told you almost immediately your original server was broken.

You must have had an idea yourself - a brief look in the logs would have told you things were not right. I'm sure you must have seen stuff when messing with owncloud and your drives.

I'm still not sure you have have told us the entire chain of events.

I don't actually care about what happened  beyond the fact that the information is important for us to diagnose the issue. It isn't to poke fun at you. It is to save us all time.

I could go back and document some of it - broken drives, affa restores, etc etc. - but it's pointless as we now know the issue, and solution.

This was never just a simple backup/restore to 10, or an issue with dns.

Yes, you could manually transfer to another linux box - you are going to have to do a manual transfer regardless - but if we had known all the info at the start we could have told you that almost immediately you opened this thread. That would have saved the most time.

I hope your migration goes well.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #67 on: August 08, 2021, 12:12:32 PM »
I'm just trying to discover what happened so we can try to fix an issue.

I've just said you haven't told us the whole story, which is true.

Because of that we've wasted a lot of time we could have spent on other things.

I have a working SME9 system as far as I know. I do not look in the logs unless I have a problem. And even if I did I do not have the knowledge to know where to look and to know if it is a serious problem when I have no problems with the server. I am no Linux expert in any way - just a daily user. I do not know what to tell you to begin with as I did not know that I had problems with my SME9 installation. How do you expect me to tell the whole story when I did not know the whole story at that point in time? I am really sorry that we all have wasted time on this problem. I just try to make this software great as I think it is a good concept.

Offline beast

  • *
  • 238
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #68 on: August 08, 2021, 12:17:06 PM »
install fresh sme10
use lazy admin tool to migrate users /domains /host. 

not sure shadow migration will work as your shadow passwrd files are borked.  you might need to redefine password for your users.

would suggest not to migrate config db and network db.

then copy using rsync your ibays/users data.

Thank you and I hope is it OK to ask here again if I have some troubles in the process?

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #69 on: August 08, 2021, 03:05:54 PM »
Thank you and I hope is it OK to ask here again if I have some troubles in the process?

Mate, we've all been there at one time or another...take JPs advice, start a new and ditch the sme9 backup, its tainted to the nth degree
--
qui scribit bis legit

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Loosing internet connection after post-upgrade of server
« Reply #70 on: August 08, 2021, 04:35:20 PM »
Please do not hesitate. 
Please just open a new thread with reference to this one, so it will be easier for latter reference to see the question and the answer and not a long succession of issues. 

Offline bunkobugsy

  • *
  • 274
  • +4/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #71 on: August 09, 2021, 10:40:25 PM »
Your problems could be related to Realtek NIC using buggy r8169 driver, you could try installing kmod-r8168 that overrides it.
If you see r8169 in dmesg or messages after a boot do this:

wget https://elrepo.org/linux/elrepo/el7/x86_64/RPMS/kmod-r8168-8.049.02-1.el7_9.elrepo.x86_64.rpm
yum localinstall kmod-r8168-8.049.02-1.el7_9.elrepo.x86_64.rpm
signal-event reboot

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #72 on: August 09, 2021, 10:57:46 PM »
Your problems could be related to Realtek NIC using buggy r8169 driver,

In this particular instance, unfortunately not :lol:
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #73 on: August 11, 2021, 02:02:40 AM »
worth investigating

message.log
Aug  5 08:46:02 beastserver kernel: md: bind<sdb1>
Aug  5 08:46:02 beastserver kernel: r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
Aug  5 08:46:02 beastserver kernel: r8169 0000:04:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
Aug  5 08:46:02 beastserver kernel: r8169 0000:04:00.0: eth0: RTL8168f/8111f at 0xffffc900068a8000, 08:60:6e:e5:3c:35, XID 08000800 IRQ 35
Aug  5 08:46:02 beastserver kernel: r8169 0000:04:00.0: eth0: jumbo features [frames: 9200 bytes, tx checksumming: ko]

and
Aug  5 08:46:04 beastserver kernel: r8169 0000:04:00.0: firmware: requesting rtl_nic/rtl8168f-1.fw
Aug  5 08:46:04 beastserver kernel: r8169 0000:04:00.0: eth1: link down
Aug  5 08:46:04 beastserver kernel: r8169 0000:04:00.0: eth1: link down
Aug  5 08:46:04 beastserver kernel: ADDRCONF(NETDEV_UP): eth1: link is not ready
Aug  5 08:46:06 beastserver kernel: r8169 0000:04:00.0: eth1: link up
« Last Edit: August 11, 2021, 02:04:14 AM by TerryF »
--
qui scribit bis legit

Offline sfhwan

  • 16
  • +0/-0
Re: Loosing internet connection after post-upgrade of server
« Reply #74 on: January 13, 2023, 06:46:01 PM »
Just curious. Is the problem reported in this thread solved already?

I encountered similar issues on migrating 3 sme9 servers to sme10 last year using Migratehelper (2 of them have this issue while the 3rd one is unaffected). The affected sme10 servers are running fine until reboot (due to software update or other reasons), as described in this thread.

It is puzzling to observe that the internet connection is so drastically affected by clearing and filling the DNS entry (alternately) in the admin console. At one point, I thought the problem could be related to the dnscache template and also the resolv.conf file but could not dig deeper due to limited knowledge in this area.

Now I still have to bring the internet connection after reboot by filling or clearing the DNS entry in admin console ... sth obviously not desirable if working remotely.