[vz-users] Datenverlust zwischen Vlogger und Middleware.
Abhijit Dhopate
abhijit.dhopate at gmail.com
Sa Okt 3 22:21:11 CEST 2020
Super… Danke für tolle Hilfe. hoffentlich jetzt funktioniert alles.
Official Volkszaehler Docker, mit Datenbank auf Synology und Vzlogger auf Raspberry Pi. Überprüfe morgen nochmal.
Wenn es ohne Probleme funktioniert, werde ich alle meine Konfigurationen posten. Hoffentlich wird das für jemand anderen nützlich sein.
_____
Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate
From: Abhijit Dhopate <abhijit.dhopate at gmail.com>
Sent: 03/Oct/2020 10:00 PM
To: 'volkszaehler.org - users' <volkszaehler-users at demo.volkszaehler.org>
Subject: RE: [vz-users] Datenverlust zwischen Vlogger und Middleware.
Gefunden !!!!
Middleware addressee ist (soll !!) “http://192.100.1.100:5582” und nicht „http://192.100.1.100:5582/middleware.php“
_____
Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate
From: Abhijit Dhopate <abhijit.dhopate at gmail.com <mailto:abhijit.dhopate at gmail.com> >
Sent: 03/Oct/2020 9:48 PM
To: 'volkszaehler.org - users' <volkszaehler-users at demo.volkszaehler.org <mailto:volkszaehler-users at demo.volkszaehler.org> >
Subject: RE: [vz-users] Datenverlust zwischen Vlogger und Middleware.
Danke. Das erklärt viele. Ich habe meine vzlogger.conf aktualisiert. Aber noch nicht beim ende :( :(
Ich bekomme folgene warnung in meine vzlogger.log… und daten nicht gespeichert…
[Oct 03 17:21:51][chn6] Adding reading to queue (value=43.00 ts=1601738511360)
[Oct 03 17:21:51][push] added to uuid 25f6a4c0-3562-11ea-8128-f76b27607ea0
[Oct 03 17:21:51][chn3] CURL: Connected to 192.100.1.100 (192.100.1.100) port 8080 (#393)
[Oct 03 17:21:51][chn3] CURL: Expire in 1000 ms for 0 (transfer 0x71d073e0)
[Oct 03 17:21:51][chn3] CURL: Sent 1586 bytes..
[Oct 03 17:21:51][chn3] CURL: Sent '[ [ 1601736825000, 332 ], [ 1601736855000, 336 ], [ 1601736885000, 330 ], [ 1601736915000, 323 ], [ 1601736945000, 332 ], [ 1601736975000, 332 ], [ 1601737005000, 333 ], [ 1601737035000, 329 ], [ 1601737065000, 2784 ], [ 1601737095000, 2787 ], [ 1601737097285, 2713 ], [ 1601737125000, 2716 ], [ 1601737155000, 2746 ], [ 1601737185000, 2754 ], [ 1601737215000, 2755 ], [ 1601737245000, 2777 ], [ 1601737247111, 2681 ], [ 1601737275000, 2686 ], [ 1601737277287, 2664 ], [ 1601737305000, 2672 ], [ 1601737335000, 2650 ], [ 1601737337127, 2648 ], [ 1601737365000, 2670 ], [ 1601737367288, 2646 ], [ 1601737395000, 2662 ], [ 1601737425000, 2663 ], [ 1601737455000, 2679 ], [ 1601737457337, 2665 ], [ 1601737485000, 2680 ], [ 1601737487516, 2665 ], [ 1601737515000, 2670 ], [ 1601737545000, 2681 ], [ 1601737575000, 2677 ], [ 1601737577341, 2623 ], [ 1601737605000, 2667 ], [ 1601737607342, 347 ], [ 1601737635000, 358 ], [ 1601737665000, 360 ], [ 1601737695000, 366 ], [ 1601737697855, 2640 ], [ 1601737725000, 2647 ], [ 1601737727489, 2606 ], [ 1601737755000, 2652 ], [ 1601737757745, 2632 ], [ 1601737785000, 2657 ], [ 1601737787121, 2638 ], [ 1601737815000, 2644 ], [ 1601737817874, 354 ], [ 1601737845000, 2646 ], [ 1601737847410, 2638 ], [ 1601737875000, 2657 ], [ 1601737878708, 373 ], [ 1601737905000, 2623 ], [ 1601737907828, 2598 ], [ 1601737908933, 2619 ], [ 1601737910037, 2620 ], [ 1601737935000, 2614 ], [ 1601737937844, 351 ], [ 1601737939814, 367 ], [ 1601737965000, 2625 ], [ 1601737967606, 2613 ], [ 1601737968710, 2617 ], [ 1601737969799, 2625 ], [ 1601737995000, 2630 ] ]' bytes
[Oct 03 17:21:51][chn3] CURL: We are completely uploaded and fine
[Oct 03 17:21:51][push] CURL Request to http://192.100.1.100:5582 succeeded with code: 200
[Oct 03 17:21:51][push] send ok to url http://192.100.1.100:5582
[Oct 03 17:21:51][push] push: { "data": [ { "uuid": "25f6a4c0-3562-11ea-8128-f76b27607ea0", "tuples": [ [ 1601738511360, 43 ] ] }, { "uuid": "03c33020-3562-11ea-846f-179bde755488", "tuples": [ [ 1601738511360, 84 ] ] }, { "uuid": "c8307540-2cd3-11ea-9cb4-a946cafba208", "tuples": [ [ 1601738511360, 325 ] ] }, { "uuid": "5d3fcca0-355e-11ea-a4c0-6d550faa9601", "tuples": [ [ 1601738511360, 197 ] ] } ] }
[Oct 03 17:21:51][chn4] ==> number of tuples: 5
[Oct 03 17:21:51][chn4] compare: 1601738480737 1601738505000
[Oct 03 17:21:51][chn4] compare: 1601738505000 1601738508063
[Oct 03 17:21:51][chn4] compare: 1601738508063 1601738509152
[Oct 03 17:21:51][chn4] compare: 1601738509152 1601738510257
[Oct 03 17:21:51][chn4] compare: 1601738510257 1601738511360
[Oct 03 17:21:51][chn4] copied 64/141 values for middleware transmission
[Oct 03 17:21:51][chn3] CURL: Received 1224 bytes
[Oct 03 17:21:51][chn3] CURL: Received '{
"version": "0.3",
"exception": {
"message": "Unknown context: 'middleware.php'",
"type": "Exception",
"code": 0,
"file": "\/vz\/lib\/Router.php",
"line": 182,
"backtrace": [
{
"file": "\/vz\/lib\/Router.php",
"line": 126,
"function": "handleRaw",
"class": "Volkszaehler\\Router"
},
{
"file": "\/vz\/vendor\/php-pm\/httpkernel-adapter\/src\/Bridges\/HttpKernel.php",
"line": 87,
"function": "handle",
"class": "Volkszaehler\\Router"
},
{
"file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
"line": 454,
"function": "handle",
"class": "PHPPM\\Bridges\\HttpKernel"
},
{
"file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
"line": 418,
"function": "handleRequest",
"class": "PHPPM\\ProcessSlave"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 49,
"function": "onRequest",
"class": "PHPPM\\ProcessSlave"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 54,
"function": "call",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Middleware\/Reques' bytes
[Oct 03 17:21:51][chn3] CURL: Received 1448 bytes
[Oct 03 17:21:51][chn3] CURL: Received 'tBodyParserMiddleware.php",
"line": 34,
"function": "React\\Http\\Io\\{closure}",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 59,
"function": "__invoke",
"class": "React\\Http\\Middleware\\RequestBodyParserMiddleware"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 54,
"function": "call",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Middleware\/RequestBodyBufferMiddleware.php",
"line": 58,
"function": "React\\Http\\Io\\{closure}",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",
"line": 28,
"function": "React\\Http\\Middleware\\{closure}",
"class": "React\\Http\\Middleware\\RequestBodyBufferMiddleware"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 134,
"function": "then",
"class": "React\\Promise\\FulfilledPromise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 168,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 231,
"function": "settle",
"class": "React\\Promise\\Promise"
},
{
"fi' bytes
[Oct 03 17:21:51][chn3] CURL: Received 2896 bytes
[Oct 03 17:21:51][chn3] CURL: Received 'le": "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",
"line": 42,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 135,
"function": "done",
"class": "React\\Promise\\FulfilledPromise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 168,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 231,
"function": "settle",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise-stream\/src\/functions.php",
"line": 75,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "React\\Promise\\Stream\\{closure}"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",
"line": 80,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",
"line": 179,
"function": "close",
"class": "React\\Http\\Io\\HttpBodyStream"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "handleEnd",
"class": "React\\Http\\Io\\HttpBodyStream"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/LengthLimitedStream.php",
"line": 87,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "handleData",
"class": "React\\Http\\Io\\LengthLimitedStream"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/CloseProtectionStream.php",
"line": 96,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "handleData",
"class": "React\\Http\\Io\\CloseProtectionStream"
},
{
"file": "\/vz\/vendor\/react\/stream\/src\/Util.php",
"line": 71,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "React\\Stream\\{closure}",
"class": "React\\Stream\\Util"
},
{
"file": "\/vz\/vendor\/react\/stream\/src\/DuplexResourceStream.php",
"line": 193,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",
"line": 245,
"function": "handleD' bytes
[Oct 03 17:21:51][chn3] CURL: Received 721 bytes
[Oct 03 17:21:51][chn3] CURL: Received 'ata",
"class": "React\\Stream\\DuplexResourceStream"
},
{
"file": "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",
"line": 212,
"function": "waitForStreamActivity",
"class": "React\\EventLoop\\StreamSelectLoop"
},
{
"file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
"line": 377,
"function": "run",
"class": "React\\EventLoop\\StreamSelectLoop"
},
{
"file": "\/tmp\/dbgOnofgp",
"line": 38,
"function": "run",
"class": "PHPPM\\ProcessSlave"
}
]
},
"debug": {
"database": "pdo_mysql",
"time": 0.00034,
"uptime": 6204753120,
"load": [
2.74,
2.97,
3.32
],
"php-version": "7.3.22",
"messages": []
}
}' bytes
_____
Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate
From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org <mailto:volkszaehler-users-bounces at demo.volkszaehler.org> > On Behalf Of Frank Richter
Sent: 03/Oct/2020 3:45 PM
To: volkszaehler.org - users <volkszaehler-users at demo.volkszaehler.org <mailto:volkszaehler-users at demo.volkszaehler.org> >
Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.
Deine Middleware läuft auf Port 8080, und vom Push-Server wirst du keine sinnvolle Antwort bekommen. Du musst den vzlogger so konfigurieren, dass er seine Daten auf Port 8080 abliefert.
Grüße
Frank
Abhijit Dhopate <abhijit.dhopate at gmail.com <mailto:abhijit.dhopate at gmail.com> > schrieb am Sa., 3. Okt. 2020, 15:38:
Okay... Jetzt fange ich von vorne an.
Egal, was ich tue, ich erhalte von meiner Middleware kein erwartetes Antwort
wie in Wiki und Daniel geschrieben ist.
Ich benutzte das offizielle Docker-Image (von hier :
https://github.com/volkszaehler/volkszaehler.org) mit meiner zentralen
Datenbank (auch auf Synology mit mariadb).
Hier ist meine
1. middleware.json: https://pastebin.com/kEG7Ehiu
2. docker compose: https://pastebin.com/KnfSWhBW
3. config.yaml: https://pastebin.com/jCDz6SgS
Ich sehe ganz daten in http://192.100.1.100:8080/data/<UUID>.json (ich denke
Push server)
Aber keine daten in Middleware
http://192.100.1.100:5582/middleware.php/<UUID>.json
Wann ich sehe Datenbank, alle meine Kanale sind in "entities". Und sehe ich
neue daten in "data" mit neue "timestamp".
Ich finde nicht was falsch ist.
Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate
-----Original Message-----
From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org <mailto:volkszaehler-users-bounces at demo.volkszaehler.org> >
On Behalf Of Daniel Lauckner
Sent: 03/Oct/2020 10:47 AM
To: volkszaehler.org <http://volkszaehler.org> - users <volkszaehler-users at demo.volkszaehler.org <mailto:volkszaehler-users at demo.volkszaehler.org> >
Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.
Hallo,
am Samstag, 3. Oktober 2020 um 10:43 hat Abhijit Dhopate geschrieben:
> Ich habe gerade mit meine Raspberry Pi geprüft. Da ich direkt Image
> geflasht hatte. Da bekomme ich auch nur 1...
Wenn die Anfrage an den selben Port ging ist das ja korrekt: es Antwortet
der PUSH-Server, nicht die Middleware.
Und deswegen gehen deine Daten verloren.
mfg Daniel
-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <http://demo.volkszaehler.org/pipermail/volkszaehler-users/attachments/20201003/ab3b180f/attachment-0001.html>
Mehr Informationen über die Mailingliste volkszaehler-users