Manually Deploy Mellanox SN2010 for Flow

DEPLOYING MELLANOX SWITCHES MANUALLY FOR FLOW

Pre Requisites –

• Modified FLOW-RED or FLOW-BLUE switch config for each node on USB
• diva_dhcp and mnset dockers on USB
• Modified dnsmasq config file for each node, generated and retrieved from 192.168.2.38 (root/Creat1ve)

Go in to the switch on serial – BAUD 115200

en
config t
reset factory keep-basic

Upgrade the switch to the latest software version –

en
config t

show version (check version running)
image fetch scp://admin@localhost/var/mnt/usb1/onyx-X86_64-3.9.3220.img
image fetch scp://admin@localhost/var/mnt/usb1/onyx-X86_64-3.10.2202.img

image install onyx-X86_64-3.9.3220.img
—–WAIT—–
reload
——Rebooting——-
Select boot option 2 from the menu during start up check the version is the same you just installed

en
config t
show version (check version running)
image install onyx-X86_64-3.10.2202.img
—–WAIT——

reload
—–REBOOTS——
No configuration wizard
Set admin / monitor password (Creat1ve)
en
config t
no vrf definition mgmt
—–REBOOTS——–
en
config t
system profile eth-ipv4-mc-max
—–REBOOTS——–
en
config t
configuration text fetch scp://admin@localhost/var/mnt/usb1/FLOW-BLUE-01
image fetch scp://admin@localhost/var/mnt/usb1/diva_dhcp.gz
image fetch scp://admin@localhost/var/mnt/usb1/mnset.gz
configuration text file FLOW-BLUE-01 apply
reload
—–REBOOTS——–
Password: Creat1ve
en
config t
docker label dhcp

Copy DNSMASQ config to dhcp label using SCP , make sure the dnsmasq config file is named as below and not the original file name generated by the script. This can be achieve using WinSCP on Windows, or via command line on Mac and specifying the below directory. Connect your laptop to the management port on the switch and use the command also below to find the switches IP address you can use to SCP transfer the config file.

/var/container_storage/dhcp/dnsmasq.conf

Connect laptop to Mgmt interface and set your IP in the same range.

show int mgmt0

[Find mgmt0 IP and copy dnsmasq config file]

Then…
docker load diva_dhcp.gz
docker load mnset.gz
reload
—–REBOOTS——–

Once switch is rebooted check the running config is correct and the dockers are active. You can verify using –

en
config t
show running-config
show docker-ps

Save your hard work!
write memory

Connecting a device to one of the switch ports should now result in it getting a DHCP address. Useful to verify correct functionality.

In case of no static drop route in config file –

Configure a drop route to stop red from being able to reach blue and visa versa.
On Red check –
ip route 10.10x.0.0 /16 null0
On Blue check –
ip route 10.x.0.0 /16 null0

All set!