歡迎光臨
每天分享高質量文章

.NetCore使用skywalking實現實時效能監控

一、簡介

很久之前寫了一篇 《.Net Core 2.0+ InfluxDB+Grafana+App Metrics 實現跨平臺的實時效能監控》關於NetCore效能監控的文章,使用Influxdb+AppMetrics進行專案效能監控,由於技術有限,在正式環境使用一段時間後,莫名的AppMetrics就沒辦法往influxdb中插入資料了,後來我也在App Metrics作者的github上留言了,並且作者也根據我闡述的情況做了測試,沒有復現我的問題,最後這個問題就不了了知了,然後專案效能監控這個事擱置了一段時間,直到2018年參加上海.net線下技術沙龍,在會場首次聽到skywalking,那時候skywalking正在做NetCore的支援,會後回到公司便開始關註skywalking,知道skywalking支援NetCore後,第一時間在公司的專案中運用了skywalking。

二、安裝環境

要想使用skywalking,首先得安裝相關環境。本文以windows為例。

1、安裝java sdk(如果不會配置java環境的話,請參考百度百科:https://jingyan.baidu.com/article/08b6a591bdb18314a80922a0.html)

2、java環境安裝完成後,下載Elasticsearch進行安裝 https://www.elastic.co/downloads/elasticsearch (本文使用skywalking 6.x版本,6.x版本對應使用ES 6.x版本,請自行下載對應版本)

3、下載完Elasticsearch 後將Elasticsearch解壓到安裝位置,以我電腦為例,我安裝在D:\Program Files

4、修改ES配置,進入ES檔案下的:\config,找到elasticsearch.yml,開啟後修改如下配置:

# ======================== Elasticsearch Configuration =========================

#

# NOTE: Elasticsearch comes with reasonable defaults for most settings.

#       Before you set out to tweak and tune the configuration, make sure you

#       understand what are you trying to accomplish and the consequences.

#

# The primary way of configuring a node is via this file. This template lists

# the most important settings you may want to configure for a production cluster.

#

# Please consult the documentation for further information on configuration options:

# https://www.elastic.co/guide/en/elasticsearch/reference/index.html

#

# ———————————- Cluster ———————————–

#

# Use a descriptive name for your cluster:

#

cluster.name: myskywalking

#

# ———————————— Node ————————————

#

# Use a descriptive name for the node:

#

node.name: node-1

#

# Add custom attributes to the node:

#

#node.attr.rack: r1

#

# ———————————– Paths ————————————

#

# Path to directory where to store the data (separate multiple locations by comma):

#

path.data: D:/Program Files/elasticsearch-6.6.2/path/to/data

#

# Path to log files:

#

path.logs: D:/Program Files/elasticsearch-6.6.2/path/to/logs

#

# ———————————– Memory ———————————–

#

# Lock the memory on startup:

#

bootstrap.memory_lock: false

#

# Make sure that the heap size is set to about half the memory available

# on the system and that the owner of the process is allowed to use this

# limit.

#

# Elasticsearch performs poorly when the system is swapping the memory.

#

# ———————————- Network ———————————–

#

# Set the bind address to a specific IP (IPv4 or IPv6):

#

network.host: 0.0.0.0

http.port: 9200

http.cors.enabled: true

http.cors.allow-origin: “*”

http.cors.allow-methods: OPTIONS,HEAD,GET,POST,PUT,DELETE

http.cors.allow-essay-headers: “X-Requested-With, Content-Type, Content-Length, X-Users”

 

#

# For more information, consult the network module documentation.

#

# ——————————— Discovery ———————————-

#

# Pass an initial list of hosts to perform discovery when new node is started:

# The default list of hosts is [“127.0.0.1”, “[::1]”]

#

#discovery.zen.ping.unicast.hosts: [“host1”, “host2”]

#

# Prevent the “split brain” by configuring the majority of nodes (total number of master-eligible nodes / 2 + 1):

#

#discovery.zen.minimum_master_nodes:

#

# For more information, consult the zen discovery module documentation.

#

# ———————————- Gateway ———————————–

#

# Block initial recovery after a full cluster restart until N nodes are started:

#

#gateway.recover_after_nodes: 3

#

# For more information, consult the gateway module documentation.

#

# ———————————- Various ———————————–

#

# Require explicit names when deleting indices:

#

#action.destructive_requires_name: true

 

修改好elasticsearch.yml檔案後,開啟cmd命令,進入到D:\Program Files\elasticsearch-6.6.2\bin,bin檔案夾下,輸入如下命令:  elasticsearch-service.bat install  將ES安裝成windows,這樣就可以方便系統重啟後自動啟動

然後將服務啟動後即可

5、接下來下載skywalking,http://skywalking.apache.org/downloads/

選擇版本為 :6.0.0-GA 的下載

三、配置和效果

1、在本地電腦中建立一個檔案夾(註意:本人親自躺過的坑,skywalking服務必須放在無空格的檔案夾,比如:Program Files這個檔案是絕對不能放的,不然服務執行的時候只會一閃而過,連log日誌都不會生成,切記!切記!切記!)

我在D盤下建立了一個叫skyworkingService檔案,路徑如下:D:\skyworkingService

將下好的skywalking解壓到該目錄下,命名為skywalking-apm-GA,路徑如下:D:\skyworkingService\skywalking-apm-GA

接著,開啟config檔案,找到application.yml檔案,修改其配置如下:

# Licensed to the Apache Software Foundation (ASF) under one

# or more contributor license agreements.  See the NOTICE file

# distributed with this work for additional information

# regarding copyright ownership.  The ASF licenses this file

# to you under the Apache License, Version 2.0 (the

# “License”); you may not use this file except in compliance

# with the License.  You may obtain a copy of the License at

#

#     http://www.apache.org/licenses/LICENSE-2.0

#

# Unless required by applicable law or agreed to in writing, software

# distributed under the License is distributed on an “AS IS” BASIS,

# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

# See the License for the specific language governing permissions and

# limitations under the License.

 

cluster:

standalone:

# Please check your ZooKeeper is 3.5+, However, it is also compatible with ZooKeeper 3.4.x. Replace the ZooKeeper 3.5+

# library the oap-libs folder with your ZooKeeper 3.4.x library.

#  zookeeper:

#    nameSpace: ${SW_NAMESPACE:””}

#    hostPort: ${SW_CLUSTER_ZK_HOST_PORT:localhost:2181}

#    #Retry Policy

#    baseSleepTimeMs: ${SW_CLUSTER_ZK_SLEEP_TIME:1000} # initial amount of time to wait between retries

#    maxRetries: ${SW_CLUSTER_ZK_MAX_RETRIES:3} # max number of times to retry

#  kubernetes:

#    watchTimeoutSeconds: ${SW_CLUSTER_K8S_WATCH_TIMEOUT:60}

#    namespace: ${SW_CLUSTER_K8S_NAMESPACE:default}

#    labelSelector: ${SW_CLUSTER_K8S_LABEL:app=collector,release=skywalking}

#    uidEnvName: ${SW_CLUSTER_K8S_UID:SKYWALKING_COLLECTOR_UID}

#  consul:

#    serviceName: ${SW_SERVICE_NAME:”SkyWalking_OAP_Cluster”}

#     Consul cluster nodes, example: 10.0.0.1:8500,10.0.0.2:8500,10.0.0.3:8500

#    hostPort: ${SW_CLUSTER_CONSUL_HOST_PORT:localhost:8500}

core:

default:

restHost: ${SW_CORE_REST_HOST:0.0.0.0}

restPort: ${SW_CORE_REST_PORT:12800}

restContextPath: ${SW_CORE_REST_CONTEXT_PATH:/}

gRPCHost: ${SW_CORE_GRPC_HOST:0.0.0.0}

gRPCPort: ${SW_CORE_GRPC_PORT:11800}

downsampling:

– Hour

– Day

– Month

# Set a timeout on metric data. After the timeout has expired, the metric data will automatically be deleted.

recordDataTTL: ${SW_CORE_RECORD_DATA_TTL:90} # Unit is minute

minuteMetricsDataTTL: ${SW_CORE_MINUTE_METRIC_DATA_TTL:90} # Unit is minute

hourMetricsDataTTL: ${SW_CORE_HOUR_METRIC_DATA_TTL:36} # Unit is hour

dayMetricsDataTTL: ${SW_CORE_DAY_METRIC_DATA_TTL:45} # Unit is day

monthMetricsDataTTL: ${SW_CORE_MONTH_METRIC_DATA_TTL:18} # Unit is month

storage:

# h2:

# driver: ${SW_STORAGE_H2_DRIVER:org.h2.jdbcx.JdbcDataSource}

# url: ${SW_STORAGE_H2_URL:jdbc:h2:mem:skywalking-oap-db}

# user: ${SW_STORAGE_H2_USER:sa}

elasticsearch:

nameSpace: ${SW_NAMESPACE:”myskywalking”}

clusterNodes: ${SW_STORAGE_ES_CLUSTER_NODES:localhost:9200}

indexShardsNumber: ${SW_STORAGE_ES_INDEX_SHARDS_NUMBER:2}

indexReplicasNumber: ${SW_STORAGE_ES_INDEX_REPLICAS_NUMBER:0}

# Batch process setting, refer to https://www.elastic.co/guide/en/elasticsearch/client/java-api/5.5/java-docs-bulk-processor.html

bulkActions: ${SW_STORAGE_ES_BULK_ACTIONS:2000} # Execute the bulk every 2000 requests

bulkSize: ${SW_STORAGE_ES_BULK_SIZE:20} # flush the bulk every 20mb

flushInterval: ${SW_STORAGE_ES_FLUSH_INTERVAL:10} # flush the bulk every 10 seconds whatever the number of requests

concurrentRequests: ${SW_STORAGE_ES_CONCURRENT_REQUESTS:2} # the number of concurrent requests

receiver-register:

default:

receiver-trace:

default:

bufferPath: ${SW_RECEIVER_BUFFER_PATH:../trace-buffer/}  # Path to trace buffer files, suggest to use absolute path

bufferOffsetMaxFileSize: ${SW_RECEIVER_BUFFER_OFFSET_MAX_FILE_SIZE:100} # Unit is MB

bufferDataMaxFileSize: ${SW_RECEIVER_BUFFER_DATA_MAX_FILE_SIZE:500} # Unit is MB

bufferFileCleanWhenRestart: ${SW_RECEIVER_BUFFER_FILE_CLEAN_WHEN_RESTART:false}

sampleRate: ${SW_TRACE_SAMPLE_RATE:10000} # The sample rate precision is 1/10000. 10000 means 100% sample in default.

receiver-jvm:

default:

#service-mesh:

#  default:

#    bufferPath: ${SW_SERVICE_MESH_BUFFER_PATH:../mesh-buffer/}  # Path to trace buffer files, suggest to use absolute path

#    bufferOffsetMaxFileSize: ${SW_SERVICE_MESH_OFFSET_MAX_FILE_SIZE:100} # Unit is MB

#    bufferDataMaxFileSize: ${SW_SERVICE_MESH_BUFFER_DATA_MAX_FILE_SIZE:500} # Unit is MB

#    bufferFileCleanWhenRestart: ${SW_SERVICE_MESH_BUFFER_FILE_CLEAN_WHEN_RESTART:false}

#istio-telemetry:

#  default:

#receiver_zipkin:

#  default:

#    host: ${SW_RECEIVER_ZIPKIN_HOST:0.0.0.0}

#    port: ${SW_RECEIVER_ZIPKIN_PORT:9411}

#    contextPath: ${SW_RECEIVER_ZIPKIN_CONTEXT_PATH:/}

query:

graphql:

path: ${SW_QUERY_GRAPHQL_PATH:/graphql}

alarm:

default:

telemetry:

none:

 

 修改完成後,進入到bin檔案中,右鍵單擊startup.bat,以管理員許可權執行,即可看到如下彈框

彈出這兩個框說明服務已經啟動了

這個時候訪問http://localhost:8080,即可看到如下介面:

預設賬號admin,密碼admin,登入後看看到想要的監控資料和各服務直接的拓撲圖,因為我的服務跑了一段時間,所以下麵的介面是有資料的:

2、由於啟動skywalking後會彈出兩個命令視窗,所以如果運維人員不小心關了視窗的話服務自然就停掉了,所以為了避免這種問題,我們還可以將bin檔案夾下的oapService.bat和webappService.bat進行配置,如下:

@REM

@REM  Licensed to the Apache Software Foundation (ASF) under one or more

@REM  contributor license agreements.  See the NOTICE file distributed with

@REM  this work for additional information regarding copyright ownership.

@REM  The ASF licenses this file to You under the Apache License, Version 2.0

@REM  (the “License”); you may not use this file except in compliance with

@REM  the License.  You may obtain a copy of the License at

@REM

@REM      http://www.apache.org/licenses/LICENSE-2.0

@REM

@REM  Unless required by applicable law or agreed to in writing, software

@REM  distributed under the License is distributed on an “AS IS” BASIS,

@REM  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

@REM  See the License for the specific language governing permissions and

@REM  limitations under the License.

 

@echo off

 

setlocal

set OAP_PROCESS_TITLE=Skywalking-Collector

set OAP_HOME=%~dp0%..

set OAP_OPTS=”-Xms256M -Xmx512M -Doap.logDir=%OAP_HOME%\logs”

 

set CLASSPATH=%OAP_HOME%\config;.;

set CLASSPATH=%OAP_HOME%\oap-libs\*;%CLASSPATH%

 

if defined JAVA_HOME (

set _EXECJAVA=”%JAVA_HOME%\bin\javaw”

)

 

if not defined JAVA_HOME (

echo “JAVA_HOME not set.”

set _EXECJAVA=javaw

)

 

start “%OAP_PROCESS_TITLE%” %_EXECJAVA% “%OAP_OPTS%” -cp “%CLASSPATH%” org.apache.skywalking.oap.server.starter.OAPServerStartUp

endlocal

 

oapService.bat

@REM

@REM  Licensed to the Apache Software Foundation (ASF) under one or more

@REM  contributor license agreements.  See the NOTICE file distributed with

@REM  this work for additional information regarding copyright ownership.

@REM  The ASF licenses this file to You under the Apache License, Version 2.0

@REM  (the “License”); you may not use this file except in compliance with

@REM  the License.  You may obtain a copy of the License at

@REM

@REM      http://www.apache.org/licenses/LICENSE-2.0

@REM

@REM  Unless required by applicable law or agreed to in writing, software

@REM  distributed under the License is distributed on an “AS IS” BASIS,

@REM  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

@REM  See the License for the specific language governing permissions and

@REM  limitations under the License.

 

@echo off

 

setlocal

set WEBAPP_PROCESS_TITLE=Skywalking-Webapp

set WEBAPP_HOME=%~dp0%..

set JARPATH=%WEBAPP_HOME%\webapp

set WEBAPP_LOG_DIR=%WEBAPP_HOME%\logs

 

if exist “%WEBAPP_LOG_DIR%” (

mkdir “%WEBAPP_LOG_DIR%”

)

 

set LOG_FILE_LOCATION=%WEBAPP_LOG_DIR%\webapp.log

 

if defined JAVA_HOME (

set _EXECJAVA=”%JAVA_HOME%\bin\javaw”

)

 

if not defined JAVA_HOME (

echo “JAVA_HOME not set.”

set _EXECJAVA=javaw

)

 

start “%WEBAPP_PROCESS_TITLE%” %_EXECJAVA%  -jar %JARPATH%/skywalking-webapp.jar –spring.config.location=%JARPATH%/webapp.yml –logging.file=%LOG_FILE_LOCATION%

endlocal

 

webappService.bat

其實只是將檔案裡的java改成了javaw,這樣就可以在後臺運行了,儲存後再次執行startup.bat檔案,這個時候介面上會有個cmd命令介面一閃而過,不要慌,我們開啟資源管理器看看,會發現行程中多了兩個名為“javaw.exe”的行程

這個時候訪問:http://localhost:8080 一樣可以看到上面的ui介面!

至此,skywalking的所有環境皆搭建完畢,接下來,在我們專案中新增skywalking的探針,方便skywalking收集我們專案中的資料

四、專案取用skywalking探針

新建一個NetCore的webapi,然後在取用中取用SkyWalking.AspNetCore,如圖:

專案取用後,在Startup.cs中註入skywalking。

在頭部取用:using SkyWalking.AspNetCore;

然後找到public void ConfigureServices(IServiceCollection services)下輸入一下程式碼即可:

services.AddSkyWalking(option =>
{
       option.ApplicationCode = "AreaServer";
      option.DirectServers = 127.0.0.1:11800;
});

執行程式碼後,控制檯內每隔幾秒就會有以下資訊輸出

證明skywalking探針已經成功,接下來請求一下你的介面,然後進入skywalking的ui中看看你的成果吧!

原文地址:https://www.cnblogs.com/landonzeng/p/10616644.html

贊(0)

分享創造快樂