我前面使用Kubernetes构建prometheus监控，没有什么大问题，但是monitoring/kube-controller-manager/0 (0/0 up)，这个没有数值。
一般出现这个问题，都是Kubernetes部署时，没有对应的标签，导致无法找到资源
问题
问题一：ip地址
正常开启的，但是这个监听端口是127.0.0.1的，普罗米修斯无法直接访问
1
2
3
|
[root@k8s-master01 jiankong]# netstat -lntp | grep control
tcp 0 0 127.0.0.1:10257 0.0.0.0:* LISTEN 112736/kube-control
tcp6 0 0 :::10252 :::* LISTEN 112736/kube-control
|
问题二：SVC没有标签资源
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
|
[root@k8s-master01 jiankong]# kubectl get servicemonitors.monitoring.coreos.com -n monitoring kube-controller-manager -oyaml
apiVersion: monitoring.coreos.com/v1
kind: ServiceMonitor
metadata:
annotations:
..............................
sourceLabels:
- __name__
- action: drop
regex: etcd_(debugging|disk|request|server).*
sourceLabels:
- __name__
port: http-metrics
jobLabel: k8s-app
namespaceSelector:
matchNames:
- kube-system
selector:
matchLabels:
k8s-app: kube-controller-manager #通过这个标签匹配kube-controller-manager
[root@k8s-master01 jiankong]# kubectl get svc -n kube-system -l k8s-app= kube-controller-manager
error: name cannot be provided when a selector is specified
#这边在kube-system没有这个标签的svc，所以无法匹配到
|
解决：
1、修改监听地址
1
2
3
|
vim /etc/kubernetes/manifests/kube-controller-manager.yaml
- --bind-address=0.0.0.0
|
开0.0.0.0，是可以的，因为Kubernetes通信需要证书，是双向的。
2、添加svc ep标签
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
|
apiVersion: v1
kind: Service
metadata:
labels:
k8s-app: kube-controller-manager
name: kube-controller-manage-monitor
namespace: kube-system
spec:
ports:
- name: http-metrics
port: 10252
protocol: TCP
targetPort: 10252
sessionAffinity: None
type: ClusterIP
apiVersion: v1
kind: Endpoints
metadata:
labels:
k8s-app: kube-controller-manager
name: kube-controller-manage-monitor
namespace: kube-system
subsets:
- addresses:
- ip: 192.168.0.100
ports:
- name: http-metrics
port: 10252
protocol: TCP
|
3、测试
