NTP change on Exadata db nodes
# grep ^server /etc/ntp.conf
server 10.120.0.10 prefer iburst burst minpoll 4 maxpoll 4
server 10.120.2.1 iburst burst minpoll 4 maxpoll 4
server 10.120.2.2 iburst burst minpoll 4 maxpoll 4
Modify the servers in /etc/ntp.conf
Now we can restart the ntp server.
# /etc/init.d/ntpd restart
Shutting down ntpd: [ OK ]
ntpd: Synchronizing with timer server: [ OK ]
Starting ntpd: [ OK ]
To force update time
# ntpd -gq
-g requests an update irrespective of the time offset, and -q requests the daemon to quit after updating the date from the ntp server.
************************************************************************************************************************************************
NTP change in storage cells
server 10.120.0.10 prefer iburst burst minpoll 4 maxpoll 4
server 10.120.2.1 iburst burst minpoll 4 maxpoll 4
server 10.120.2.2 iburst burst minpoll 4 maxpoll 4
Log in as the root user.
####Check status
cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
####Make grid disks inactive
cellcli -e alter griddisk all inactive
####Verify if offline
cellcli -e list griddisk
cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
####Shut down services
cellcli -e alter cell shutdown services all
service ocrvottargetd stop
####Change NTP settings as above
/usr/local/bin/ipconf
####Verify NTP settings
grep ^server /etc/ntp.conf
####Startup services
service ocrvottargetd start
cellcli -e alter cell startup services all
####Make grid disks online
cellcli -e alter griddisk all active
####Verify grid disks are online
cellcli -e list griddisk
cellcli -e list griddisk attributes name, asmmodestatus
After this if time is still wrong force update it
service ntpd stop
ntpd -gq
service ntpd start
Once everything is synced and online repeast same steps on other cells..
******************************************************************************
[root@xxx ~]# cellcli -e alter cell shutdown services all
Stopping the RS, CELLSRV, and MS services...
The SHUTDOWN of services was successful.
[root@xxx ~]# service ocrvottargetd stop
ocrvottargetd: unrecognized service
[root@xxx ~]# /usr/local/bin/ipconf
[Info]: ipconf command line: /opt/oracle.cellos/ipconf.pl -nocodes
Logging started to /var/log/cellos/ipconf.log
Interface ib0 is Linked. hca: mlx4_0
Interface ib1 is Linked. hca: mlx4_0
Interface eth0 is Linked. driver/mac: ixgbe/00:10:e0:b4:18:ac
Interface eth1 is .................... Unlinked. driver/mac: ixgbe/00:10:e0:b4:18:ad
Interface eth2 is .................... Unlinked. driver/mac: ixgbe/00:10:e0:b4:18:ae
Interface eth3 is .................... Unlinked. driver/mac: ixgbe/00:10:e0:b4:18:af
Network interfaces
Name State
ib0 Linked
ib1 Linked
eth0 Linked
eth1 Unlinked
eth2 Unlinked
eth3 Unlinked
[Warning]: Some network interface(s) are disconnected. Check cables and swicthes and retry
Do you want to retry (y/n) [y]: n
The current nameserver(s): 10.120.11.6 10.120.11.7
Do you want to change it (y/n) [n]:
The current timezone: America/Los_Angeles
Do you want to change it (y/n) [n]:
The current NTP server(s): 10.120.0.10 216.239.32.15
Do you want to change it (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.0.10
Continue adding more ntp servers (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.2.1
Continue adding more ntp servers (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.2.2
Continue adding more ntp servers (y/n) [n]:
Network interfaces
Name State Status IP address Netmask Gateway Net type Hostname
ib0 Linked UP 192.168.10.26 255.255.252.0 Private xxx-priv1.hke.local
ib1 Linked UP 192.168.10.27 255.255.252.0 Private xxx-priv2.hke.local
eth0 Linked UP 10.120.16.203 255.255.255.0 10.120.16.1 Management xxx.hke.local
eth1 Unlinked UNCONF
eth2 Unlinked UNCONF
eth3 Unlinked UNCONF
Select interface name to configure or press Enter to continue:
Select canonical hostname from the list below
1: xxx-priv1.hke.local
2: xxx-priv2.hke.local
3: xxx.hke.local
Canonical fully qualified domain name [3]:
Select default gateway interface from the list below
1: eth0
Default gateway interface [1]:
Canonical hostname: xxx.hke.local
Nameservers: 10.120.11.6 10.120.11.7
Timezone: America/Los_Angeles
NTP servers: 10.120.0.10 10.120.2.1 10.120.2.2
Default gateway device: eth0
Network interfaces
Name State Status IP address Netmask Gateway Net type Hostname
ib0 Linked UP 192.168.10.26 255.255.252.0 Private xxx-priv1.hke.local
ib1 Linked UP 192.168.10.27 255.255.252.0 Private xxx-priv2.hke.local
eth0 Linked UP 10.120.16.203 255.255.255.0 10.120.16.1 Management xxx.hke.local
eth1 Unlinked UNCONF
eth2 Unlinked UNCONF
eth3 Unlinked UNCONF
Is this correct (y/n) [y]:
Do you want to configure basic ILOM settings (y/n) [y]:
Loading basic configuration settings from ILOM ...
ILOM Fully qualified hostname [xxx-ilom.hke.local]:
Inet protocol (IPv4,IPv6) [IPv4]:
ILOM IP address [10.120.16.11]:
ILOM Netmask [255.255.255.0]:
ILOM Gateway or none [10.120.16.1]:
ILOM Nameserver (multiple IPs separated by a comma) or none [10.120.11.6]:
ILOM Use NTP Servers (enabled/disabled) [enabled]:
ILOM First NTP server. Fully qualified hostname or ip address or none [10.120.0.10]:
ILOM Second NTP server. Fully qualified hostname or ip address or none [216.239.32.15]: 10.120.2.1
ILOM Vlan id or zero for non-tagged VLAN (0-4079) [0]:
Basic ILOM configuration settings:
Hostname : xxx-ilom.hke.local
IP Address : 10.120.16.11
Netmask : 255.255.255.0
Gateway : 10.120.16.1
DNS servers : 10.120.11.6
Use NTP servers : enabled
First NTP server : 10.120.0.10
Second NTP server : 10.120.2.1
Timezone (read-only) : America/Los_Angeles
VLAN id : 0
Is this correct (y/n) [y]:
[Info]: Run /opt/oracle.cellos/validations/init.d/saveconfig
[Info]: Stopping cellwall service ...
cellwall: Flushing firewall rules: [ OK ]
[Info]: cellwall service stopped
[Info]: Restart ntpd service
Shutting down ntpd: [ OK ]
Starting ntpd: [ OK ]
[Info]: Starting cellwall service ...
cellwall: Checking network interfaces: [ OK ]
cellwall: Checking ILOM interface: [ OK ]
cellwall: Flushing firewall rules: [ OK ]
cellwall: Applying firewall rules: [ OK ]
[Info]: cellwall service started
[Info]: Save /etc/sysctl.conf in /etc/sysctl.conf.backupbyExadata
[Info]: Adjust settings for IB interfaces in /etc/sysctl.conf
Re-login using new IP address 10.120.16.203 if you were disconnected after following commands
ip addr show eth0
sleep 4
[Warning]: You modified NTP server.
Ensure you also update the Infiniband Switch NTP server
if the same NTP server was also used by the Infiniband switch.
*****************************************************************************************************
NTP change in Infiniband switches
Login to infiniband using ilom-admin user default password is welcome1
check existing ntp configuration
show -d properties /SP/clients/ntp/server/1
show -d properties /SP/clients/ntp/server/2
check ntp status
show -d properties /SP/clock
To check current time
show /SP/clock datetime
Change ntp server address
set /SP/clients/ntp/server/1 address=10.120.0.10
set /SP/clients/ntp/server/2 address=10.120.2.1
*****************************************************************************************************
On solaris
ntpq -p
this lists ntp servers
cd /etc/inet
vi ntp.conf
edit the servers to new servers
Example:
server 10.120.2.1 prefer
server 10.120.2.2
# grep ^server /etc/ntp.conf
server 10.120.0.10 prefer iburst burst minpoll 4 maxpoll 4
server 10.120.2.1 iburst burst minpoll 4 maxpoll 4
server 10.120.2.2 iburst burst minpoll 4 maxpoll 4
Modify the servers in /etc/ntp.conf
Now we can restart the ntp server.
# /etc/init.d/ntpd restart
Shutting down ntpd: [ OK ]
ntpd: Synchronizing with timer server: [ OK ]
Starting ntpd: [ OK ]
To force update time
# ntpd -gq
-g requests an update irrespective of the time offset, and -q requests the daemon to quit after updating the date from the ntp server.
************************************************************************************************************************************************
NTP change in storage cells
server 10.120.0.10 prefer iburst burst minpoll 4 maxpoll 4
server 10.120.2.1 iburst burst minpoll 4 maxpoll 4
server 10.120.2.2 iburst burst minpoll 4 maxpoll 4
Log in as the root user.
####Check status
cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
####Make grid disks inactive
cellcli -e alter griddisk all inactive
####Verify if offline
cellcli -e list griddisk
cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
####Shut down services
cellcli -e alter cell shutdown services all
service ocrvottargetd stop
####Change NTP settings as above
/usr/local/bin/ipconf
####Verify NTP settings
grep ^server /etc/ntp.conf
####Startup services
service ocrvottargetd start
cellcli -e alter cell startup services all
####Make grid disks online
cellcli -e alter griddisk all active
####Verify grid disks are online
cellcli -e list griddisk
cellcli -e list griddisk attributes name, asmmodestatus
After this if time is still wrong force update it
service ntpd stop
ntpd -gq
service ntpd start
Once everything is synced and online repeast same steps on other cells..
******************************************************************************
[root@xxx ~]# cellcli -e alter cell shutdown services all
Stopping the RS, CELLSRV, and MS services...
The SHUTDOWN of services was successful.
[root@xxx ~]# service ocrvottargetd stop
ocrvottargetd: unrecognized service
[root@xxx ~]# /usr/local/bin/ipconf
[Info]: ipconf command line: /opt/oracle.cellos/ipconf.pl -nocodes
Logging started to /var/log/cellos/ipconf.log
Interface ib0 is Linked. hca: mlx4_0
Interface ib1 is Linked. hca: mlx4_0
Interface eth0 is Linked. driver/mac: ixgbe/00:10:e0:b4:18:ac
Interface eth1 is .................... Unlinked. driver/mac: ixgbe/00:10:e0:b4:18:ad
Interface eth2 is .................... Unlinked. driver/mac: ixgbe/00:10:e0:b4:18:ae
Interface eth3 is .................... Unlinked. driver/mac: ixgbe/00:10:e0:b4:18:af
Network interfaces
Name State
ib0 Linked
ib1 Linked
eth0 Linked
eth1 Unlinked
eth2 Unlinked
eth3 Unlinked
[Warning]: Some network interface(s) are disconnected. Check cables and swicthes and retry
Do you want to retry (y/n) [y]: n
The current nameserver(s): 10.120.11.6 10.120.11.7
Do you want to change it (y/n) [n]:
The current timezone: America/Los_Angeles
Do you want to change it (y/n) [n]:
The current NTP server(s): 10.120.0.10 216.239.32.15
Do you want to change it (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.0.10
Continue adding more ntp servers (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.2.1
Continue adding more ntp servers (y/n) [n]: y
Fully qualified hostname or ip address for NTP server. Press enter if none: 10.120.2.2
Continue adding more ntp servers (y/n) [n]:
Network interfaces
Name State Status IP address Netmask Gateway Net type Hostname
ib0 Linked UP 192.168.10.26 255.255.252.0 Private xxx-priv1.hke.local
ib1 Linked UP 192.168.10.27 255.255.252.0 Private xxx-priv2.hke.local
eth0 Linked UP 10.120.16.203 255.255.255.0 10.120.16.1 Management xxx.hke.local
eth1 Unlinked UNCONF
eth2 Unlinked UNCONF
eth3 Unlinked UNCONF
Select interface name to configure or press Enter to continue:
Select canonical hostname from the list below
1: xxx-priv1.hke.local
2: xxx-priv2.hke.local
3: xxx.hke.local
Canonical fully qualified domain name [3]:
Select default gateway interface from the list below
1: eth0
Default gateway interface [1]:
Canonical hostname: xxx.hke.local
Nameservers: 10.120.11.6 10.120.11.7
Timezone: America/Los_Angeles
NTP servers: 10.120.0.10 10.120.2.1 10.120.2.2
Default gateway device: eth0
Network interfaces
Name State Status IP address Netmask Gateway Net type Hostname
ib0 Linked UP 192.168.10.26 255.255.252.0 Private xxx-priv1.hke.local
ib1 Linked UP 192.168.10.27 255.255.252.0 Private xxx-priv2.hke.local
eth0 Linked UP 10.120.16.203 255.255.255.0 10.120.16.1 Management xxx.hke.local
eth1 Unlinked UNCONF
eth2 Unlinked UNCONF
eth3 Unlinked UNCONF
Is this correct (y/n) [y]:
Do you want to configure basic ILOM settings (y/n) [y]:
Loading basic configuration settings from ILOM ...
ILOM Fully qualified hostname [xxx-ilom.hke.local]:
Inet protocol (IPv4,IPv6) [IPv4]:
ILOM IP address [10.120.16.11]:
ILOM Netmask [255.255.255.0]:
ILOM Gateway or none [10.120.16.1]:
ILOM Nameserver (multiple IPs separated by a comma) or none [10.120.11.6]:
ILOM Use NTP Servers (enabled/disabled) [enabled]:
ILOM First NTP server. Fully qualified hostname or ip address or none [10.120.0.10]:
ILOM Second NTP server. Fully qualified hostname or ip address or none [216.239.32.15]: 10.120.2.1
ILOM Vlan id or zero for non-tagged VLAN (0-4079) [0]:
Basic ILOM configuration settings:
Hostname : xxx-ilom.hke.local
IP Address : 10.120.16.11
Netmask : 255.255.255.0
Gateway : 10.120.16.1
DNS servers : 10.120.11.6
Use NTP servers : enabled
First NTP server : 10.120.0.10
Second NTP server : 10.120.2.1
Timezone (read-only) : America/Los_Angeles
VLAN id : 0
Is this correct (y/n) [y]:
[Info]: Run /opt/oracle.cellos/validations/init.d/saveconfig
[Info]: Stopping cellwall service ...
cellwall: Flushing firewall rules: [ OK ]
[Info]: cellwall service stopped
[Info]: Restart ntpd service
Shutting down ntpd: [ OK ]
Starting ntpd: [ OK ]
[Info]: Starting cellwall service ...
cellwall: Checking network interfaces: [ OK ]
cellwall: Checking ILOM interface: [ OK ]
cellwall: Flushing firewall rules: [ OK ]
cellwall: Applying firewall rules: [ OK ]
[Info]: cellwall service started
[Info]: Save /etc/sysctl.conf in /etc/sysctl.conf.backupbyExadata
[Info]: Adjust settings for IB interfaces in /etc/sysctl.conf
Re-login using new IP address 10.120.16.203 if you were disconnected after following commands
ip addr show eth0
sleep 4
[Warning]: You modified NTP server.
Ensure you also update the Infiniband Switch NTP server
if the same NTP server was also used by the Infiniband switch.
*****************************************************************************************************
NTP change in Infiniband switches
Login to infiniband using ilom-admin user default password is welcome1
check existing ntp configuration
show -d properties /SP/clients/ntp/server/1
show -d properties /SP/clients/ntp/server/2
check ntp status
show -d properties /SP/clock
To check current time
show /SP/clock datetime
Change ntp server address
set /SP/clients/ntp/server/1 address=10.120.0.10
set /SP/clients/ntp/server/2 address=10.120.2.1
*****************************************************************************************************
On solaris
ntpq -p
this lists ntp servers
cd /etc/inet
vi ntp.conf
edit the servers to new servers
Example:
server 10.120.2.1 prefer
server 10.120.2.2
After this save the file.
Now disable and enable ntpd
svcadm disable ntp
svcadm enable ntp
verify time servers
ntpq -p
date
