config

• upgrading jenkins

• java configuration

• threadDump

• agent

• security

• mailing format

• properties in jenkins core for JAVA_OPTS

• System Properties

• Configuring HTTP

• tips

references:

• Jenkins Features Controlled with System Properties

• * How to Setup Jenkins Build Agents on Kubernetes Pods

• Quick and Simple — How to Setup Jenkins Distributed (Master-Slave) Build on Kubernetes

• [stable/jenkins] Add Custom Trusted CA certificates

• How to install a Jenkins instance with Helm

• helm-charts/charts/jenkins/README.md

• docker/README.md

• InfoSec812/pipeline-libraries.groovy

• to get groovy version:

  println GroovySystem.version

• official yml

  • jenkins-sa.yaml

  • jenkins-volume.yaml

  • jenkins-deployment.yaml

  • jenkins-service.yaml

upgrading jenkins

jenkins 2.357 requires Java 11

Beginning with Jenkins 2.357 (released on June 28, 2022) and the forthcoming September LTS release, Jenkins requires Java 11. Additionally, beginning with Jenkins 2.355 (released on June 14, 2022) and Jenkins 2.346.1 LTS (released on June 22, 2022), Jenkins supports Java 17. Plugins have already been prepared in JENKINS-68446. Use the Plugin Manager to upgrade all plugins before and after upgrading to Jenkins 2.357.

refrences:

• Upgrading Jenkins Java version from 8 to 11

  • JVM version on agents

• Java requirements

• Downloading and running Jenkins in Docker

• ** Prepare Jenkins for Support

  • JVM Recommended Arguments

• Upgrading to Java 11 or 17

• Setting JVM Options for Application Servers

  -Xms1024m
  -Xmx2048m
  -XX:PermSize=32m
  -XX:MaxPermSize=512m
  -Xss2m

• Java Documentations

• get java version from jenkins controller

  // https://jenkins.domain/script - for contorller's java version
  println System.getProperty('java.specification.version')
  // 17
  
  // in cmd
  $ groovy -e "println System.getProperty('java.specification.version')"
  24

  println " >> jenkins.rootUrl: ${Jenkins.instance.rootUrl} "
  println " >> jenkins.version: ${Jenkins.instance.version} "
  System.getProperties()
        .findAll { it.key.toLowerCase().contains( 'java' ) }
        .each { println " >>> ${it.key} ~> ${it.value}" }
  
  "DONE"

  • result

    >> jenkins.rootUrl: https://jenkins.domain.com/
    >> jenkins.version: 2.360
    >>> java.specification.version ~> 11
    >>> java.runtime.version ~> 11.0.15+10
    >>> java.class.path ~> /usr/share/jenkins/jenkins.war
    >>> java.vm.vendor ~> Eclipse Adoptium
    >>> javamelody.maven-repositories ~> /var/jenkins_home/.m2/repository,http://repo1.maven.org/maven2,http://repo.jenkins-ci.org/public
    >>> java.runtime.name ~> OpenJDK Runtime Environment
    >>> javamelody.gzip-compression-disabled ~> true
    >>> java.vendor.url ~> https://adoptium.net/
    >>> javamelody.About Monitoring ~> https://plugins.jenkins.io/monitoring/
    >>> java.vm.specification.version ~> 11
    >>> java.vm.name ~> OpenJDK 64-Bit Server VM
    >>> java.vendor.version ~> Temurin-11.0.15+10
    >>> javamelody.http-transform-pattern ~> /\d+/|(?<=/static/|/adjuncts/|/bound/)[\w\-]+|(?<=/ws/|/user/|/testReport/|/javadoc/|/site/|/violations/file/|/cobertura/).+|(?<=/job/).+(?=/descriptorByName/)
    >>> sun.java.launcher ~> SUN_STANDARD
    >>> sun.java.command ~> /usr/share/jenkins/jenkins.war
    >>> java.vendor.url.bug ~> https://github.com/adoptium/adoptium-support/issues
    >>> javamelody.system-actions-enabled ~> true
    >>> java.io.tmpdir ~> /tmp
    >>> javamelody.storage-directory ~> //var/jenkins_home/monitoring
    >>> java.version ~> 11.0.15
    >>> javamelody.custom-reports ~> Jenkins Info,About Monitoring
    >>> java.specification.vendor ~> Oracle Corporation
    >>> java.vm.specification.name ~> Java Virtual Machine Specification
    >>> java.awt.printerjob ~> sun.print.PSPrinterJob
    >>> java.version.date ~> 2022-04-19
    >>> java.home ~> /opt/java/openjdk
    >>> java.vm.compressedOopsMode ~> Zero based
    >>> java.library.path ~> /usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
    >>> java.specification.name ~> Java Platform API Specification
    >>> java.vm.specification.vendor ~> Oracle Corporation
    >>> java.vm.info ~> mixed mode
    >>> java.vendor ~> Eclipse Adoptium
    >>> java.vm.version ~> 11.0.15+10
    >>> java.awt.graphicsenv ~> sun.awt.X11GraphicsEnvironment
    >>> java.awt.headless ~> true
    >>> javamelody.csrf-protection-enabled ~> true
    >>> java.class.version ~> 55.0
    >>> javamelody.Jenkins Info ~> /systemInfo
    >>> javamelody.no-database ~> true
    Result: DONE

• get Java version from Jenkins agent

  println " >> jenkins.rootUrl: ${Jenkins.instance.rootUrl}"
  println " >> jenkins.version: ${Jenkins.instance.version}"
  
  Jenkins.instance.nodes.each { agent ->
    println " >> agent: ${agent.displayName}"
    agent.computer.getSystemProperties()
         .findAll{ it.key.toLowerCase().contains( 'java' ) }
         .each { println " ~~> ${it.key} -> ${it.value}" }
  }

  • result

    >> jenkins.rootUrl: https://jenkins.domain.com/
    >> jenkins.version: 2.360
    >> agent: yaml-15-x946w-s48xb-jqkn0
    ~~> java.awt.graphicsenv -> sun.awt.X11GraphicsEnvironment
    ~~> java.awt.printerjob -> sun.print.PSPrinterJob
    ~~> java.class.path -> /usr/share/jenkins/slave.jar
    ~~> java.class.version -> 55.0
    ~~> java.home -> /usr/lib/jvm/java-11-openjdk-amd64
    ~~> java.io.tmpdir -> /tmp
    ~~> java.library.path -> /usr/java/packages/lib:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
    ~~> java.runtime.name -> OpenJDK Runtime Environment
    ~~> java.runtime.version -> 11.0.15+10-Ubuntu-0ubuntu0.18.04.1
    ~~> java.specification.name -> Java Platform API Specification
    ~~> java.specification.vendor -> Oracle Corporation
    ~~> java.specification.version -> 11
    ~~> java.vendor -> Private Build
    ~~> java.vendor.url -> Unknown
    ~~> java.vendor.url.bug -> Unknown
    ~~> java.version -> 11.0.15
    ~~> java.version.date -> 2022-04-19
    ~~> java.vm.compressedOopsMode -> Zero based
    ~~> java.vm.info -> mixed mode, sharing
    ~~> java.vm.name -> OpenJDK 64-Bit Server VM
    ~~> java.vm.specification.name -> Java Virtual Machine Specification
    ~~> java.vm.specification.vendor -> Oracle Corporation
    ~~> java.vm.specification.version -> 11
    ~~> java.vm.vendor -> Private Build
    ~~> java.vm.version -> 11.0.15+10-Ubuntu-0ubuntu0.18.04.1
    ~~> javamelody.no-database -> true
    ~~> sun.java.command -> hudson.remoting.jnlp.Main -headless -tunnel 1.2.3.4:12345 -url https://jenkins.domain.com/ -workDir /home/devops ae62043877285d6ba763f254ce041f64674ce2c4768d9872621af0ea65c07b2d yaml-15-x946w-s48xb-jqkn0
    ~~> sun.java.launcher -> SUN_STANDARD
    Result: [KubernetesSlave name: yaml-15-x946w-s48xb-jqkn0]

• or via RemotingDiagnostics

  import hudson.util.RemotingDiagnostics
  import jenkins.model.Jenkins
  
  println " >> jenkins.rootUrl: ${Jenkins.instance.rootUrl}"
  println " >> jenkins.version: ${Jenkins.instance.version}"
  
  String result
  String javaVersion = """
    def stdout = new StringBuffer()
    def stderr = new StringBuffer()
    "java -version".execute().waitForProcessOutput( stdout, stderr )
    println stderr
  """
  
  Jenkins.instance.nodes.each { agent ->
    println ">> agent: ${agent.displayName}"
    result = RemotingDiagnostics.executeGroovy( javaVersion.trim(), agent.channel )
                    .tokenize( '\n' )
                    .collect{ "\t${it}" }
                    .join( '\n' )
  }
  println ">>> java version: \n${result}"

  • result

    >> jenkins.rootUrl: https://jenkins.domain.com/
    >> jenkins.version: 2.360
    >> agent: yaml-15-x946w-s48xb-jqkn0
    >>> java version:
      openjdk version "11.0.15" 2022-04-19
      OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.18.04.1)
      OpenJDK 64-Bit Server VM (build 11.0.15+10-Ubuntu-0ubuntu0.18.04.1, mixed mode, sharing)

java configuration

[!TIP|label:official recommended]

• ** A. Java Configuration

• ** Memory problem: 'unable to create new native thread'

• * Too many open files

• * Supported Java 8 arguments

• * Supported Java 11 arguments

• ** Java Heap settings Best Practice

  • Minimum and maximum heap sizes

• Enterprise JVM Administration and Jenkins Performance

• CloudBees Jenkins JVM troubleshooting

• How to Troubleshoot and Address Jenkins Startup Performances

• How to generate a thread dump?

• Jenkins : Obtaining a thread dump

• Required Data: Jenkins Hang Issue On Linux

• Upgrading to Jenkins 2.176.2 : Improved CSRF protection

• JENKINS-71273: Gerrit Trigger fails to connect Gerrit 2.14 - com.jcraft.jsch.JSchException: verify: false

  -Djsch.client_pubkey="ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,rsa-sha2-512,rsa-sha2-256,ssh-rsa"
  -Djsch.server_host_key="ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,rsa-sha2-512,rsa-sha2-256,ssh-rsa"

• java 11

  [!NOTE]

  • Omitting -XX:+UnlockDiagnosticVMOptions or -XX:+UnlockExperimentalVMOptions might cause your instance to fail to startup.

  • To increase GC logs to a longer period of time, we suggest

    • increasing the value of the arguments -Xlog option filecount=2 and/or filesize=100M

    • and as ultimate option use file=${LOGDIR}/gc-%t.log instead of file=${LOGDIR}/gc.log.

    • With the parameter %t, the JVM create a new set of GC files each time that the instance is restarted. It is well known that when the GC log folder gets big enough in terms of size, the support bundle might produce performance issues in the instance given that it needs to compress all of them.

  -XX:+AlwaysPreTouch
  -XX:+HeapDumpOnOutOfMemoryError
  -XX:HeapDumpPath=${LOGDIR}
  -XX:+UseG1GC
  -XX:+UseStringDeduplication
  -XX:+ParallelRefProcEnabled
  -XX:+DisableExplicitGC
  -XX:+UnlockDiagnosticVMOptions
  -XX:+UnlockExperimentalVMOptions
  -Xlog:gc*=info,gc+heap=debug,gc+ref*=debug,gc+ergo*=trace,gc+age*=trace:file=${LOGDIR}/gc.log:utctime,pid,level,tags:filecount=2,filesize=100M
  -XX:ErrorFile=${LOGDIR}/hs_err_%p.log
  -XX:+LogVMOutput
  -XX:LogFile=${LOGDIR}/jvm.log
  # Heap setting for CloudBees CI on modern cloud platforms:
  #   -XX:InitialRAMPercentage=50.0 -XX:MaxRAMPercentage=50.0
  # Heap setting for CloudBees CI on traditional platforms:
  #   Heap Size `-Xmx` and `-Xms` should be set to the same value, and determined by following the above section "JVM Heap Size"

• java 8

  [!NOTE]

  • To increase GC logs to a longer period of time, we suggest

    • increasing the value of the arguments -XX:GCLogFileSize and -XX:NumberOfGCLogFiles

    • and as ultimate option use -Xloggc:${LOGDIR}/gc-%t.log instead of -Xloggc:${LOGDIR}/gc.log.

    • With the parameter %t, the JVM create a new set of GC files each time that the instance is restarted. It is well known that when the GC log folder gets big enough in terms of size, the support bundle might produce performance issues in the instance given that it needs to compress all of them.

  -Dhudson.security.csrf.DefaultCrumbIssuer.EXCLUDE_SESSION_ID=true
  -Djenkins.model.Jenkins.logStartupPerformance=true
  -Xms192G
  -Xmx192G
  -XX:+AlwaysPreTouch
  -XX:+HeapDumpOnOutOfMemoryError
  -XX:HeapDumpPath=/var/jenkins_home/logs
  -XX:+UseG1GC
  -XX:+UseStringDeduplication
  -XX:+ParallelRefProcEnabled
  -XX:+DisableExplicitGC
  -XX:+UnlockDiagnosticVMOptions
  -XX:+UnlockExperimentalVMOptions
  -verbose:gc
  -XX:+PrintGC
  -XX:+PrintGCDetails
  -XX:ErrorFile=/var/jenkins_home/logs/hs_err_%p.log
  -XX:+LogVMOutput
  -XX:LogFile=/var/jenkins_home/logs/jvm.log
  -XX:InitialRAMPercentage=50.0
  -XX:MaxRAMPercentage=50.0
  -Xlog:gc*=info,gc+heap=debug,gc+ref*=debug,gc+ergo*=trace,gc+age*=trace:file=/var/jenkins_home/logs/gc-%t.log:utctime,pid,level,tags:filecount=2,filesize=100M

  • more info

    $ docker run --rm openjdk:8-jre java -XX:MaxRAMPercentage=75 -help 2>&1 | head
    Improperly specified VM option 'MaxRAMPercentage=75'
    Error: Could not create the Java Virtual Machine.
    Error: A fatal exception has occurred. Program will exit.
    $ docker run --rm openjdk:8-jre java -XX:MaxRAMPercentage=75.0 -help 2>&1 | head
    Usage: java [-options] class [args...]
               (to execute a class)
       or  java [-options] -jar jarfile [args...]
               (to execute a jar file)
    where options include:
        -d32    use a 32-bit data model if available
        -d64    use a 64-bit data model if available
        -server   to select the "server" VM
                      The default VM is server,
                      because you are running on a server-class machine.

  -XX:+AlwaysPreTouch
  -XX:+HeapDumpOnOutOfMemoryError
  -XX:HeapDumpPath=${LOGDIR}
  -XX:+UseG1GC
  -XX:+UseStringDeduplication
  -XX:+ParallelRefProcEnabled
  -XX:+DisableExplicitGC
  -XX:+UnlockDiagnosticVMOptions
  -XX:+UnlockExperimentalVMOptions
  -verbose:gc
  -Xloggc:${LOGDIR}/gc.log
  -XX:NumberOfGCLogFiles=2
  -XX:+UseGCLogFileRotation
  -XX:GCLogFileSize=100m
  -XX:+PrintGC
  -XX:+PrintGCDateStamps
  -XX:+PrintGCDetails
  -XX:+PrintHeapAtGC
  -XX:+PrintGCCause
  -XX:+PrintTenuringDistribution
  -XX:+PrintReferenceGC
  -XX:+PrintAdaptiveSizePolicy
  -XX:ErrorFile=${LOGDIR}/hs_err_%p.log
  -XX:+LogVMOutput
  -XX:LogFile=${LOGDIR}/jvm.log
  # Heap setting for CloudBees CI on modern cloud platforms:
  #   -XX:InitialRAMPercentage=50.0 -XX:MaxRAMPercentage=50.0
  # Heap setting for CloudBees CI on traditional platforms:
  #   Heap Size `-Xmx` and `-Xms` should be set to the same value, and determined by following the above section "JVM Heap Size"

threadDump

[!NOTE]

• visit via GUI: https://.domain.com/threadDump

• Using Thread Dumps

• How to generate a thread dump?

• Jenkins : Obtaining a thread dump

agent

ssh agent dockerfile

• JVM 11 for windows

  • windowsservercore-ltsc2019

  • nanoserver-ltsc2019

• alpine

• bullseye

• Launching inbound TCP agents

• Connecting inbound agents

$ sudo update-alternatives --remove java /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java

show TCP inbound agent port

$ curl -Lv https://jenkins.sample.com/tcpSlaveAgentListener 2>&1 | grep -i X-Jenkins-JNLP-Port
< x-jenkins-jnlp-port: 50000

using websocket for jnlp

[!NOTE|label:references:]

• WebSocket

• Connecting inbound agents

  • Configuring inbound agents using self-signed certificates

• Launching inbound TCP agents

• How to access webSockets for Jenkins inbound agents?

$ java -jar agent.jar -url https://jenkins.sample.com/ \
       -secret 9d************************************************************cc \
       -name "jenkins-agent" \
       -workDir "/home/devops" \
       -webSocket            # enable websocket

# or

$ java -cp agent.jar hudson.remoting.jnlp.Main -url ${JENKINS_URL} \
       -webSocket \          # enable websocket
       -workDir /tmp/jenkins \
       -secret ${TOKEN} \
       websocket-agent

agent.jar

$ java -jar agent.jar -help
 -agentLog FILE                         : Local agent error log destination
                                          (overrides workDir)
 -auth user:pass                        : (deprecated) unused; use -credentials
                                          or -proxyCredentials
 -cert VAL                              : Specify additional X.509 encoded PEM
                                          certificates to trust when connecting
                                          to Jenkins root URLs. If starting
                                          with @ then the remainder is assumed
                                          to be the name of the certificate
                                          file to read.
 -connectTo HOST:PORT                   : (deprecated) make a TCP connection to
                                          the given host and port, then start
                                          communication.
 -credentials (-jnlpCredentials)        : HTTP BASIC AUTH header to pass in for
 USER:PASSWORD                            making HTTP requests.
 -direct (-directConnection) HOST:PORT  : Connect directly to this TCP agent
                                          port, skipping the HTTP(S) connection
                                          parameter download. For example,
                                          "myjenkins:50000".
 -failIfWorkDirIsMissing                : Fails the initialization if the
                                          requested workDir or internalDir are
                                          missing ('false' by default)
                                          (default: false)
 -headless                              : (deprecated; now always headless)
 -help                                  : Show this help message (default: true)
 -instanceIdentity VAL                  : The base64 encoded InstanceIdentity
                                          byte array of the Jenkins controller.
                                          When this is set, the agent skips
                                          connecting to an HTTP(S) port for
                                          connection info.
 -internalDir VAL                       : Specifies a name of the internal
                                          files within a working directory
                                          ('remoting' by default) (default:
                                          remoting)
 -jar-cache DIR                         : Cache directory that stores jar files
                                          sent from the controller
 -jnlpUrl URL                           : instead of talking to the controller
                                          via stdin/stdout, emulate a JNLP
                                          client by making a TCP connection to
                                          the controller. Connection parameters
                                          are obtained by parsing the JNLP file.
 -loggingConfig FILE                    : Path to the property file with
                                          java.util.logging settings
 -name VAL                              : Name of the agent.
 -noCertificateCheck (-disableHttpsCert : Ignore SSL validation errors - use as
 Validation)                              a last resort only. (default: false)
 -noKeepAlive                           : Disable TCP socket keep alive on
                                          connection to the controller.
                                          (default: false)
 -noReconnect (-noreconnect)            : Doesn't try to reconnect when a
                                          communication fail, and exit instead
                                          (default: false)
 -ping                                  : (deprecated; now always pings)
 -protocols VAL                         : Specify the remoting protocols to
                                          attempt when instanceIdentity is
                                          provided.
 -proxyCredentials USER:PASSWORD        : HTTP BASIC AUTH header to pass in for
                                          making HTTP authenticated proxy
                                          requests.
 -secret HEX_SECRET                     : Agent connection secret.
 -tcp FILE                              : (deprecated) instead of talking to
                                          the controller via stdin/stdout,
                                          listens to a random local port, write
                                          that port number to the given file,
                                          then wait for the controller to
                                          connect to that port.
 -text                                  : encode communication with the
                                          controller with base64. Useful for
                                          running agent over 8-bit unsafe
                                          protocol like telnet
 -tunnel HOST:PORT                      : Connect to the specified host and
                                          port, instead of connecting directly
                                          to Jenkins. Useful when connection to
                                          Jenkins needs to be tunneled. Can be
                                          also HOST: or :PORT, in which case
                                          the missing portion will be
                                          auto-configured like the default
                                          behavior.
 -url URL                               : Specify the Jenkins root URLs to
                                          connect to.
 -version                               : Shows the version of the remoting jar
                                          and then exits (default: false)
 -webSocket                             : Make a WebSocket connection to
                                          Jenkins rather than using the TCP
                                          port. (default: false)
 -webSocketHeader NAME=VALUE            : Additional WebSocket header to set,
                                          eg for authenticating with reverse
                                          proxies. To specify multiple headers,
                                          call this flag multiple times, one
                                          with each header
 -workDir FILE                          : Declares the working directory of the
                                          remoting instance (stores cache and
                                          logs by default)

security

Git Host Key Verification Configuration

[!TIP|label:references:]

• * iMarslo: get servers public key

$ ssh-keyscan -H www.sample.com

# or
$ ssh-keyscan -p 29418 -t rsa www.sample.com
$ ssh-keyscan -p 29418 -t rsa www.sample.com | pbcopy

mailing format

• show the logs after building

  • Format:

    ${BUILD_LOG, maxLines, escapeHtml}
    maxLines: 250

  • For example:

    ${BUILD_LOG, maxLines=8000, escapeHtml=true}

properties in jenkins core for JAVA_OPTS

disable the

<useSecurity>true</useSecurity>
<authorizationStrategy class="hudson.security.AuthorizationStrategy$Unsecured"/>
<securityRealm class="hudson.security.SecurityRealm$None"/>

Disabling CSRF Protection

reference:

• CSRF Protection

-Dhudson.security.csrf.GlobalCrumbIssuerConfiguration.DISABLE_CSRF_PROTECTION=true

CSRF protection tokens did not expire

SECURITY-626 :

Scripts that obtain a crumb using the `/crumbIssuer/api` URL will now fail to perform actions protected from CSRF unless the scripts retain the web session ID in subsequent requests.

-Dhudson.security.csrf.DefaultCrumbIssuer.EXCLUDE_SESSION_ID=true

enable crumb proxy compatibility

-Djenkins.model.Jenkins.crumbIssuerProxyCompatibility=true

change workspace name

# default
-Djenkins.model.Jenkins.workspaceDirName='workspace'

workspace path

# default
-Djenkins.model.Jenkins.workspacesDir="${JENKINS_HOME}/workspace/${ITEM_FULL_NAME}"

a cache for UserDetails should be valid

# default 2 mins
-Djenkins.security.UserDetailsCache.EXPIRE_AFTER_WRITE_SEC=120

copyArtifacts v1.29 : JENKINS-14999 : Support for QueueItemAuthenticator

-Dhudson.security.ArtifactsPermission=true

Unauthorized view fragment access

# to disable the feature
-Djenkins.security.stapler.StaplerDispatchValidator.disabled=false

permissive-script-security.enabled

[!NOTE|label:references:]

• Permissive Script Security

• Permissive Script Plugin issues

• Pipeline - Script Security

# enable
-Dpermissive-script-security.enabled=true

# disable
-Dpermissive-script-security.enabled=no_security

System Properties

[!TIP|label:references:]

• java.lang.System

• java.util.Properties

• jenkins.util.SystemProperties

• Controlling features of Hudson using system properties

set property

System.setProperty('org.apache.commons.jelly.tags.fmt.timeZone', 'Asia/Shanghai')
System.setProperty('user.timezone', 'Asia/Shanghai')

• setup user.timezone in Jenkins

  println( System.getProperty('user.timezone') );
  System.setProperty('user.timezone', 'Asia/Shanghai');
  println( System.getProperty('user.timezone') )

• enable crumb proxy compatibility

  System.setProperty('jenkins.model.Jenkins.crumbIssuerProxyCompatibility', 'true')
  System.getProperty('jenkins.model.Jenkins.crumbIssuerProxyCompatibility')

• setup CSRF protection tokens did not expire for SECURITY-626

  System.setProperty('hudson.security.csrf.DefaultCrumbIssuer.EXCLUDE_SESSION_ID', 'true')
  System.getProperty('hudson.security.csrf.DefaultCrumbIssuer.EXCLUDE_SESSION_ID')

get property

• get all properties

  System.getProperties()

• or

  System.getProperties().each { k, v ->
    println " >>> ${k} ~> ${v} "
  }

get system environment :

• System.getenv()

  System.getenv().each { k, v ->
    println " >>> ${k} ~> ${v} "
  }

i.e.: ```groovy System.getenv().JAVA_OPTS ```

Configuring HTTP

remote configuration

[!NOTE|label:references:] information:

• ${PROTOCOL_FULLY_QUALIFIED_NAME}.disabled: where PROTOCOL_FULLY_QUALIFIED_NAME equals PROTOCOL_HANDLER_CLASSNAME without the Handler suffix.

- description - `hudson.remoting.FlightRecorderInputStream.BUFFER_SIZE` : Size (in bytes) of the flight recorder ring buffer used for debugging remoting issues - `hudson.remoting.Launcher.pingIntervalSec` : Seconds between ping checks to monitor health of agent nodes; 0 to disable ping | - `hudson.remoting.Launcher.pingTimeoutSec` : If ping of agent node takes longer than this, consider it dead; 0 to disable ping | - `hudson.remoting.RemoteClassLoader.force` : Class name String. Forces loading of the specified class name on incoming requests. Works around issues like JENKINS-19445 | - `hudson.remoting.Engine.socketTimeout` : Socket read timeout in milliseconds. If timeout happens and the failOnSocketTimeoutInReader property is true, the channel will be interrupted. | - `hudson.remoting.SynchronousCommandTransport.failOnSocketTimeoutInReader` : Boolean flag. Enables the original aggressive behavior, when the channel reader gets interrupted by any SocketTimeoutException | - `hudson.remoting.ExportTable.unexportLogSize` : Defines number of entries to be stored in the unexport history, which is being analyzed during the invalid object ID analysis. | - `${PROTOCOL_FULLY_QUALIFIED_NAME}.disabled` : Boolean flag, which allows disabling particular protocols in remoting. Property example: org.jenkinsci.remoting.engine.JnlpProtocol3.disabled | - `org.jenkinsci.remoting.nio.NioChannelHub.disabled` : Boolean flag to disable NIO-based socket connection handling, and switch back to classic IO. Used to isolate the problem. | - `org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver.protocolNamesToTry` : If specified, only the protocols from the list will be tried during the connection. The option provides protocol names, but the order of the check is defined internally and cannot be changed. |

SYSTEM PROPERTY	DEFAULT VALUE	SINCE	JENKINS VERSION(S)	RELATED ISSUES
hudson.remoting.FlightRecorderInputStream.BUFFER_SIZE	1048576	2.41	1.563	JENKINS-22734
hudson.remoting.Launcher.pingIntervalSec	0 since 2.60, 600 before	2.0	1.367	JENKINS-35190
hudson.remoting.Launcher.pingTimeoutSec	240	2.0	1.367	N/A
hudson.remoting.RemoteClassLoader.force	null	2.58	2.4	JENKINS-19445 (workaround)
hudson.remoting.Engine.socketTimeout	30 minutes	2.58	2.4	JENKINS-34808
hudson.remoting.SynchronousCommandTransport.failOnSocketTimeoutInReader	false	2.60	TODO	JENKINS-22722
hudson.remoting.ExportTable.unexportLogSize	1024	2.40	?	JENKINS-20707
${PROTOCOL_FULLY_QUALIFIED_NAME}.disabled	false	2.59	2.4	JENKINS-34819
org.jenkinsci.remoting.nio.NioChannelHub.disabled	false	2.62.3	TODO	JENKINS-39290
org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver.protocolNamesToTry	false	TODO	TODO	JENKINS-41730

tips

• Add Users to Jenkins with "Allow users to sign up" Disabled

  $JENKINS_URL/securityRealm/addUser

• sa.yml

  [!NOTE|label:references:]

  • How To Setup Jenkins On Kubernetes Cluster – Beginners Guide

  • How to Setup Jenkins Build Agents on Kubernetes Pods

  • sample 1

    ---
    apiVersion: rbac.authorization.k8s.io/v1
    kind: ClusterRole
    metadata:
      name: jenkins-admin
    rules:
      - apiGroups: [""]
        resources: ["*"]
        verbs: ["*"]
    
    ---
    apiVersion: v1
    kind: ServiceAccount
    metadata:
      name: jenkins-admin
      namespace: devops-tools
    
    ---
    apiVersion: rbac.authorization.k8s.io/v1
    kind: ClusterRoleBinding
    metadata:
      name: jenkins-admin
    roleRef:
      apiGroup: rbac.authorization.k8s.io
      kind: ClusterRole
      name: jenkins-admin
    subjects:
    - kind: ServiceAccount
      name: jenkins-admin
      namespace: devops-tools

  • sample 2

    apiVersion: v1
    kind: ServiceAccount
    metadata:
      name: jenkins-admin
      namespace: devops-tools
    ---
    apiVersion: rbac.authorization.k8s.io/v1
    kind: Role
    metadata:
      name: jenkins
      namespace: devops-tools
      labels:
        "app.kubernetes.io/name": 'jenkins'
    rules:
    - apiGroups: [""]
      resources: ["pods"]
      verbs: ["create","delete","get","list","patch","update","watch"]
    - apiGroups: [""]
      resources: ["pods/exec"]
      verbs: ["create","delete","get","list","patch","update","watch"]
    - apiGroups: [""]
      resources: ["pods/log"]
      verbs: ["get","list","watch"]
    - apiGroups: [""]
      resources: ["secrets"]
      verbs: ["get"]
    ---
    apiVersion: rbac.authorization.k8s.io/v1
    kind: RoleBinding
    metadata:
      name: jenkins-role-binding
      namespace: devops-tools
    roleRef:
      apiGroup: rbac.authorization.k8s.io
      kind: Role
      name: jenkins
    subjects:
    - kind: ServiceAccount
      name: jenkins-admin
      namespace: devops-tools

• ssl

  [!NOTE|label:references:]

  • SSL Certificates Troubleshooting

  • How to install a new SSL certificate on Traditional Platforms?

  • jenkins-scripts/scriptler/checkSSLConnection.groovy

  • JAVA_OPT: Jenkins Features Controlled with System Properties

  $ kubectl exec -it devops-jenkins-0 -- /bin/bash
  $ jrunscript -Djavax.net.ssl.trustStore=/opt/java/openjdk/lib/security/cacerts -Djavax.net.ssl.trustStorePassword=changeit -e "println(new java.net.URL(\"https://k8s-api.example.com:16443\").openConnection().getResponseCode())"
  Warning: Nashorn engine is planned to be removed from a future JDK release
  java.lang.RuntimeException: javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
    at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptRuntime.apply(ScriptRuntime.java:531)
    ...
  
  $ mkdir -p /var/jenkins_home/cacerts-share
  $ cp /opt/java/openjdk/lib/security/cacerts /var/jenkins_home/cacerts-share/cacerts
  $ chmod 644 /var/jenkins_home/cacerts-share/cacerts
  $ keytool -import -noprompt -trustcacerts -alias k8s-api -keystore /var/jenkins_home/cacerts-share/cacerts -file /run/secrets/additional/devops_kubernetes_api.crt -storepass changeit
  Certificate was added to keystore
  $ jrunscript -Djavax.net.ssl.trustStore=/var/jenkins_home/cacerts-share/cacerts -Djavax.net.ssl.trustStorePassword=changeit -e "println(new java.net.URL(\"https://k8s-api.example.com:16443\").openConnection().getResponseCode())"
  Warning: Nashorn engine is planned to be removed from a future JDK release
  403

  • full step

    $ keytool -printcert -rfc -sslserver ssdfw-k8s-api.sample.com:16443 > /run/secrets/additional/devops_kubernetes_api.crt
    # or
    $ echo -n | openssl s_client -connect ssdfw-k8s-api.sample.com:16443 | sed -ne '/-BEGIN CERTIFICATE-/,/-END CERTIFICATE-/p' > /run/secrets/additional/devops_kubernetes_api.crt