Skip to content

Commit

Permalink
Create a load testing EPP client (#2415)
Browse files Browse the repository at this point in the history
* Create a load testing EPP client.

This code is mostly based off of what was used for a past EPP load testing client that can be found in Google3 at https://source.corp.google.com/piper///depot/google3/experimental/users/jianglai/proxy/java/google/registry/proxy/client/

I modified the old client to be open-source friendly and use Gradle.

For now, this only performs a login and logout command, I will further expand on this in later PRs to add other EPP commands so that we can truly load test the system.

* Small changes

* Remove unnecessary build dep

* Add gradle build tasks

* Small fixes

* Add an instances setUp and cleanUp script

* More modifications to instance setup scripts

* change to ubuntu instance

* Add comment to make ssh work
  • Loading branch information
sarahcaseybot authored May 23, 2024
1 parent ab4bac0 commit 0781010
Show file tree
Hide file tree
Showing 12 changed files with 759 additions and 3 deletions.
6 changes: 3 additions & 3 deletions config/presubmits.py
Original file line number Diff line number Diff line change
Expand Up @@ -100,12 +100,12 @@ def fails(self, file):
{"node_modules/"}, REQUIRED):
"Source files must end in a newline.",

# System.(out|err).println should only appear in tools/
# System.(out|err).println should only appear in tools/ or load-testing/
PresubmitCheck(
r".*\bSystem\.(out|err)\.print", "java", {
"StackdriverDashboardBuilder.java", "/tools/", "/example/",
"RegistryTestServerMain.java", "TestServerExtension.java",
"FlowDocumentationTool.java"
"/load-testing/", "RegistryTestServerMain.java",
"TestServerExtension.java", "FlowDocumentationTool.java"
}):
"System.(out|err).println is only allowed in tools/ packages. Please "
"use a logger instead.",
Expand Down
54 changes: 54 additions & 0 deletions load-testing/build.gradle
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
// Copyright 2024 The Nomulus Authors. All Rights Reserved.
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.

apply plugin: 'java'

createUberJar('buildLoadTestClient', 'loadTest', 'google.registry.client.EppClient')

dependencies {
def deps = rootProject.dependencyMap
implementation deps['joda-time:joda-time']
implementation deps['io.netty:netty-buffer']
implementation deps['io.netty:netty-codec']
implementation deps['io.netty:netty-codec-http']
implementation deps['io.netty:netty-common']
implementation deps['io.netty:netty-handler']
implementation deps['io.netty:netty-transport']
implementation deps['com.google.guava:guava']
implementation deps['org.bouncycastle:bcpg-jdk18on']
implementation deps['org.bouncycastle:bcpkix-jdk18on']
implementation deps['org.bouncycastle:bcprov-jdk18on']
implementation deps['org.jcommander:jcommander']
implementation deps['com.google.flogger:flogger']
runtimeOnly deps['com.google.flogger:flogger-system-backend']
}

task makeStagingDirectory {
mkdir layout.buildDirectory.dir('stage')
}

task copyFilesToStaging(dependsOn: makeStagingDirectory, type: Copy) {
from layout.buildDirectory.file('libs/loadTest.jar'), "${projectDir}/certificate.pem", "${projectDir}/key.pem"
into layout.buildDirectory.dir('stage')
}

task deployLoadTestsToInstances (dependsOn: copyFilesToStaging, type: Exec) {
executable "sh"
workingDir "${projectDir}/"
args "-c", "./deploy.sh"
}

test {
useJUnitPlatform()
}
17 changes: 17 additions & 0 deletions load-testing/deploy.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
#!/bin/bash
# Copyright 2024 The Nomulus Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

HOSTS=$(gcloud compute instances list | awk '/^loadtest/ { print $5 }')
for host in $HOSTS; do rsync -avz ./build/stage/ $host:test-client/; done
19 changes: 19 additions & 0 deletions load-testing/instanceCleanUp.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
#!/bin/bash
# Copyright 2024 The Nomulus Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# Find and delete the instances used for load testing

gcloud compute instances list --filter="name ~ loadtest.*" --zones us-east4-a \
--format="value(name)" | xargs gcloud compute instances delete --zone us-east4-a
39 changes: 39 additions & 0 deletions load-testing/instanceSetUp.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
#!/bin/bash
# Copyright 2024 The Nomulus Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# Create the instances - modify this number for the amount of instances you
# would like to use for your load test
gcloud compute instances create loadtest-{1..2} --machine-type g1-small \
--image-family ubuntu-2204-lts --image-project ubuntu-os-cloud --zone us-east4-a

sleep 10

# Get all the created load tests instances
HOSTS=$(gcloud compute instances list | awk '/^loadtest/ { print $5 }')

#Install rsync and Java - Retry is needed here since ssh connection will fail until instances are fully provisioned
for host in $HOSTS;
do
for i in {1..60}; do
if ssh $host 'sudo apt-get -y update &&
sudo apt-get -y upgrade &&
sudo apt-get -y install rsync &&
sudo apt-get -y install openjdk-21-jdk'; then
break
else
sleep 5
fi
done
done
21 changes: 21 additions & 0 deletions load-testing/run.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
#!/bin/bash
# Copyright 2024 The Nomulus Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

HOSTS=$(gcloud compute instances list | awk '/^loadtest/ { print $5 }')

for host in $HOSTS;
do ssh $host 'cd test-client/ &&
java -jar loadTest.jar --host epp.example --certificate certificate.pem -k key.pem -pw examplePassword -ft';
done
Loading

0 comments on commit 0781010

Please sign in to comment.