[vz-users] Datenverlust zwischen Vlogger und Middleware.

Frank Richter frank.richter83 at gmail.com
Sa Okt 3 21:58:39 CEST 2020


Lass mal das /middleware.php weg und trag nur http://IP:Port im vzlogger
ein.

Abhijit Dhopate <abhijit.dhopate at gmail.com> schrieb am Sa., 3. Okt. 2020,
21:48:

> Danke. Das erklärt viele. Ich habe meine vzlogger.conf aktualisiert. Aber
> noch nicht beim ende :( L
>
> Ich bekomme folgene warnung in meine vzlogger.log… und daten nicht
> gespeichert…
>
>
>
> [Oct 03 17:21:51][chn6] Adding reading to queue (value=43.00
> ts=1601738511360)
>
> [Oct 03 17:21:51][push] added to uuid 25f6a4c0-3562-11ea-8128-f76b27607ea0
>
> [Oct 03 17:21:51][chn3] CURL: Connected to 192.100.1.100 (192.100.1.100)
> port 8080 (#393)
>
> [Oct 03 17:21:51][chn3] CURL: Expire in 1000 ms for 0 (transfer 0x71d073e0)
>
> [Oct 03 17:21:51][chn3] CURL: Sent 1586 bytes..
>
> [Oct 03 17:21:51][chn3] CURL: Sent '[ [ 1601736825000, 332 ], [
> 1601736855000, 336 ], [ 1601736885000, 330 ], [ 1601736915000, 323 ], [
> 1601736945000, 332 ], [ 1601736975000, 332 ], [ 1601737005000, 333 ], [
> 1601737035000, 329 ], [ 1601737065000, 2784 ], [ 1601737095000, 2787 ], [
> 1601737097285, 2713 ], [ 1601737125000, 2716 ], [ 1601737155000, 2746 ], [
> 1601737185000, 2754 ], [ 1601737215000, 2755 ], [ 1601737245000, 2777 ], [
> 1601737247111, 2681 ], [ 1601737275000, 2686 ], [ 1601737277287, 2664 ], [
> 1601737305000, 2672 ], [ 1601737335000, 2650 ], [ 1601737337127, 2648 ], [
> 1601737365000, 2670 ], [ 1601737367288, 2646 ], [ 1601737395000, 2662 ], [
> 1601737425000, 2663 ], [ 1601737455000, 2679 ], [ 1601737457337, 2665 ], [
> 1601737485000, 2680 ], [ 1601737487516, 2665 ], [ 1601737515000, 2670 ], [
> 1601737545000, 2681 ], [ 1601737575000, 2677 ], [ 1601737577341, 2623 ], [
> 1601737605000, 2667 ], [ 1601737607342, 347 ], [ 1601737635000, 358 ], [
> 1601737665000, 360 ], [ 1601737695000, 366 ], [ 1601737697855, 2640 ], [
> 1601737725000, 2647 ], [ 1601737727489, 2606 ], [ 1601737755000, 2652 ], [
> 1601737757745, 2632 ], [ 1601737785000, 2657 ], [ 1601737787121, 2638 ], [
> 1601737815000, 2644 ], [ 1601737817874, 354 ], [ 1601737845000, 2646 ], [
> 1601737847410, 2638 ], [ 1601737875000, 2657 ], [ 1601737878708, 373 ], [
> 1601737905000, 2623 ], [ 1601737907828, 2598 ], [ 1601737908933, 2619 ], [
> 1601737910037, 2620 ], [ 1601737935000, 2614 ], [ 1601737937844, 351 ], [
> 1601737939814, 367 ], [ 1601737965000, 2625 ], [ 1601737967606, 2613 ], [
> 1601737968710, 2617 ], [ 1601737969799, 2625 ], [ 1601737995000, 2630 ] ]'
> bytes
>
> [Oct 03 17:21:51][chn3] CURL: We are completely uploaded and fine
>
> [Oct 03 17:21:51][push] CURL Request to http://192.100.1.100:5582
> succeeded with code: 200
>
> [Oct 03 17:21:51][push] send ok to url http://192.100.1.100:5582
>
> [Oct 03 17:21:51][push] push: { "data": [ { "uuid":
> "25f6a4c0-3562-11ea-8128-f76b27607ea0", "tuples": [ [ 1601738511360, 43 ] ]
> }, { "uuid": "03c33020-3562-11ea-846f-179bde755488", "tuples": [ [
> 1601738511360, 84 ] ] }, { "uuid": "c8307540-2cd3-11ea-9cb4-a946cafba208",
> "tuples": [ [ 1601738511360, 325 ] ] }, { "uuid":
> "5d3fcca0-355e-11ea-a4c0-6d550faa9601", "tuples": [ [ 1601738511360, 197 ]
> ] } ] }
>
> [Oct 03 17:21:51][chn4] ==> number of tuples: 5
>
> [Oct 03 17:21:51][chn4] compare: 1601738480737 1601738505000
>
> [Oct 03 17:21:51][chn4] compare: 1601738505000 1601738508063
>
> [Oct 03 17:21:51][chn4] compare: 1601738508063 1601738509152
>
> [Oct 03 17:21:51][chn4] compare: 1601738509152 1601738510257
>
> [Oct 03 17:21:51][chn4] compare: 1601738510257 1601738511360
>
> [Oct 03 17:21:51][chn4] copied 64/141 values for middleware transmission
>
> [Oct 03 17:21:51][chn3] CURL: Received 1224 bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received '{
>
>                 "version": "0.3",
>
>                 "exception": {
>
>                                 "message": "Unknown context:
> 'middleware.php'",
>
>                                 "type": "Exception",
>
>                                 "code": 0,
>
>                                 "file": "\/vz\/lib\/Router.php",
>
>                                 "line": 182,
>
>                                 "backtrace": [
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/lib\/Router.php",
>
>                                                                 "line":
> 126,
>
>
> "function": "handleRaw",
>
>                                                                 "class":
> "Volkszaehler\\Router"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/php-pm\/httpkernel-adapter\/src\/Bridges\/HttpKernel.php",
>
>                                                                 "line": 87,
>
>
> "function": "handle",
>
>                                                                 "class":
> "Volkszaehler\\Router"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
>
>                                                                 "line":
> 454,
>
>
> "function": "handle",
>
>                                                                 "class":
> "PHPPM\\Bridges\\HttpKernel"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
>
>                                                                 "line":
> 418,
>
>
> "function": "handleRequest",
>
>                                                                 "class":
> "PHPPM\\ProcessSlave"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
>
>                                                                 "line": 49,
>
>
> "function": "onRequest",
>
>                                                                 "class":
> "PHPPM\\ProcessSlave"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
>
>                                                                 "line": 54,
>
>
> "function": "call",
>
>                                                                 "class":
> "React\\Http\\Io\\MiddlewareRunner"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Middleware\/Reques' bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received 1448 bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received 'tBodyParserMiddleware.php",
>
>                                                                 "line": 34,
>
>
> "function": "React\\Http\\Io\\{closure}",
>
>                                                                 "class":
> "React\\Http\\Io\\MiddlewareRunner"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
>
>                                                                 "line": 59,
>
>
> "function": "__invoke",
>
>                                                                 "class":
> "React\\Http\\Middleware\\RequestBodyParserMiddleware"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
>
>                                                                 "line": 54,
>
>
> "function": "call",
>
>                                                                 "class":
> "React\\Http\\Io\\MiddlewareRunner"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Middleware\/RequestBodyBufferMiddleware.php",
>
>                                                                 "line": 58,
>
>
> "function": "React\\Http\\Io\\{closure}",
>
>                                                                 "class":
> "React\\Http\\Io\\MiddlewareRunner"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",
>
>                                                                 "line": 28,
>
>
> "function": "React\\Http\\Middleware\\{closure}",
>
>                                                                 "class":
> "React\\Http\\Middleware\\RequestBodyBufferMiddleware"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/Promise.php",
>
>                                                                 "line":
> 134,
>
>
> "function": "then",
>
>                                                                 "class":
> "React\\Promise\\FulfilledPromise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/Promise.php",
>
>                                                                 "line":
> 168,
>
>
> "function": "React\\Promise\\{closure}",
>
>                                                                 "class":
> "React\\Promise\\Promise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/Promise.php",
>
>                                                                 "line":
> 231,
>
>
> "function": "settle",
>
>                                                                 "class":
> "React\\Promise\\Promise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "fi' bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received 2896 bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received 'le":
> "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",
>
>                                                                 "line": 42,
>
>
> "function": "React\\Promise\\{closure}",
>
>                                                                 "class":
> "React\\Promise\\Promise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/Promise.php",
>
>                                                                 "line":
> 135,
>
>
> "function": "done",
>
>                                                                 "class":
> "React\\Promise\\FulfilledPromise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/Promise.php",
>
>                                                                 "line":
> 168,
>
>
> "function": "React\\Promise\\{closure}",
>
>                                                                 "class":
> "React\\Promise\\Promise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise\/src\/Promise.php",
>
>                                                                 "line":
> 231,
>
>
> "function": "settle",
>
>                                                                 "class":
> "React\\Promise\\Promise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/promise-stream\/src\/functions.php",
>
>                                                                 "line": 75,
>
>
> "function": "React\\Promise\\{closure}",
>
>                                                                 "class":
> "React\\Promise\\Promise"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
>
>                                                                 "line":
> 123,
>
>
> "function": "React\\Promise\\Stream\\{closure}"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",
>
>                                                                 "line": 80,
>
>
> "function": "emit",
>
>                                                                 "class":
> "Evenement\\EventEmitter"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",
>
>                                                                 "line":
> 179,
>
>
> "function": "close",
>
>                                                                 "class":
> "React\\Http\\Io\\HttpBodyStream"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
>
>                                                                 "line":
> 123,
>
>
> "function": "handleEnd",
>
>                                                                 "class":
> "React\\Http\\Io\\HttpBodyStream"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/LengthLimitedStream.php",
>
>                                                                 "line": 87,
>
>
> "function": "emit",
>
>                                                                 "class":
> "Evenement\\EventEmitter"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
>
>                                                                 "line":
> 123,
>
>
> "function": "handleData",
>
>                                                                 "class":
> "React\\Http\\Io\\LengthLimitedStream"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/http\/src\/Io\/CloseProtectionStream.php",
>
>                                                                 "line": 96,
>
>
> "function": "emit",
>
>                                                                 "class":
> "Evenement\\EventEmitter"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
>
>                                                                 "line":
> 123,
>
>
> "function": "handleData",
>
>                                                                 "class":
> "React\\Http\\Io\\CloseProtectionStream"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/stream\/src\/Util.php",
>
>                                                                 "line": 71,
>
>
> "function": "emit",
>
>                                                                 "class":
> "Evenement\\EventEmitter"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
>
>                                                                 "line":
> 123,
>
>
> "function": "React\\Stream\\{closure}",
>
>                                                                 "class":
> "React\\Stream\\Util"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/stream\/src\/DuplexResourceStream.php",
>
>                                                                 "line":
> 193,
>
>
> "function": "emit",
>
>                                                                 "class":
> "Evenement\\EventEmitter"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",
>
>                                                                 "line":
> 245,
>
>
> "function": "handleD' bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received 721 bytes
>
> [Oct 03 17:21:51][chn3] CURL: Received 'ata",
>
>                                                                 "class":
> "React\\Stream\\DuplexResourceStream"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",
>
>                                                                 "line":
> 212,
>
>
> "function": "waitForStreamActivity",
>
>                                                                 "class":
> "React\\EventLoop\\StreamSelectLoop"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
>
>                                                                 "line":
> 377,
>
>
> "function": "run",
>
>                                                                 "class":
> "React\\EventLoop\\StreamSelectLoop"
>
>                                                 },
>
>                                                 {
>
>                                                                 "file":
> "\/tmp\/dbgOnofgp",
>
>                                                                 "line": 38,
>
>
> "function": "run",
>
>                                                                 "class":
> "PHPPM\\ProcessSlave"
>
>                                                 }
>
>                                 ]
>
>                 },
>
>                 "debug": {
>
>                                 "database": "pdo_mysql",
>
>                                 "time": 0.00034,
>
>                                 "uptime": 6204753120,
>
>                                 "load": [
>
>                                                 2.74,
>
>                                                 2.97,
>
>                                                 3.32
>
>                                 ],
>
>                                 "php-version": "7.3.22",
>
>                                 "messages": []
>
>                 }
>
> }' bytes
>
>
>
>
> ------------------------------
>
> Mit freundlichen Grüßen / With Regards,
>
> Abhijit Dhopate
>
>
>
> *From:* volkszaehler-users <
> volkszaehler-users-bounces at demo.volkszaehler.org> *On Behalf Of *Frank
> Richter
> *Sent:* 03/Oct/2020 3:45 PM
> *To:* volkszaehler.org - users <volkszaehler-users at demo.volkszaehler.org>
> *Subject:* Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.
>
>
>
> Deine Middleware läuft auf Port 8080, und vom Push-Server wirst du keine
> sinnvolle Antwort bekommen. Du musst den vzlogger so konfigurieren, dass er
> seine Daten auf Port 8080 abliefert.
>
>
>
> Grüße
>
> Frank
>
>
>
> Abhijit Dhopate <abhijit.dhopate at gmail.com> schrieb am Sa., 3. Okt. 2020,
> 15:38:
>
> Okay... Jetzt fange ich von vorne an.
> Egal, was ich tue, ich erhalte von meiner Middleware kein erwartetes
> Antwort
> wie in Wiki und Daniel geschrieben ist.
>
> Ich benutzte das offizielle Docker-Image (von hier :
> https://github.com/volkszaehler/volkszaehler.org)  mit meiner zentralen
> Datenbank (auch auf Synology mit mariadb).
> Hier ist meine
> 1. middleware.json:  https://pastebin.com/kEG7Ehiu
> 2. docker compose: https://pastebin.com/KnfSWhBW
> 3. config.yaml: https://pastebin.com/jCDz6SgS
>
> Ich sehe ganz daten in http://192.100.1.100:8080/data/<UUID>.json (ich
> denke
> Push server)
> Aber keine daten in Middleware
> http://192.100.1.100:5582/middleware.php/<UUID>.json
>
> Wann ich sehe Datenbank, alle meine Kanale sind in "entities". Und sehe ich
> neue daten in "data" mit neue "timestamp".
> Ich finde nicht was falsch ist.
>
> Mit freundlichen Grüßen / With Regards,
> Abhijit Dhopate
>
> -----Original Message-----
> From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org
> >
> On Behalf Of Daniel Lauckner
> Sent: 03/Oct/2020 10:47 AM
> To: volkszaehler.org - users <volkszaehler-users at demo.volkszaehler.org>
> Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.
>
> Hallo,
>
>
> am Samstag, 3. Oktober 2020 um 10:43 hat Abhijit Dhopate geschrieben:
> > Ich habe gerade mit meine Raspberry Pi geprüft. Da ich direkt Image
> > geflasht hatte. Da bekomme ich auch nur 1...
>
> Wenn die Anfrage an den selben Port ging ist das ja korrekt: es Antwortet
> der PUSH-Server, nicht die Middleware.
>
> Und deswegen gehen deine Daten verloren.
>
>
> mfg Daniel
>
>
-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <http://demo.volkszaehler.org/pipermail/volkszaehler-users/attachments/20201003/20a264bb/attachment-0001.html>


Mehr Informationen über die Mailingliste volkszaehler-users